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ABSTH^CT 

The focus of this project has been the .preparation of a manual 
aimed at the improvement of both the design of longitudinal research 
and the analysis of data a-rising therefrom. Primary substantive 
emphasis has teen given to issues related to educational and develop- 
mental research. Topics of particular salience to longitudinal 
researchers include: (a) the explicit differentiation between intra- 
individual variation, interindividual differences, and interindividual 
differences in intraindividual change; (b) stochastic iDodels of de- 
velopmental change; (c) mathematical representation of growth curves; 
(d) structural equation models; (e) analysis of variance applications, 
both univariate and multivariate; and (f) analysis of categorical 
data. . 



PREFACE 

This report to the National Institute o£ Education represents 

It 

the core of an advanced manual being developed to aid the design and 
conduct of longitudinal research in the behavioral and social sciences 
in general with particular eniphasis ort developmental/educational 
concerns. The various chapters presented here, as well as a few 
additional ones to be included in a projected commercially available 
voluoie> cover aspects of formulating research questions that are 
inherently longitudinal, designing appropriate empirical research 
studies, and analyzing effectively the resulting data. Our primary 
concern in choosing topics and selecting authors has been to provide 
this manual as a common meeting place, as it were, between leading 
experts in particularly salient aspects of longitudinal research 
and eiqjirical researchers whose capacity for asking keen and interesting 
substantive questions exceeds their familiarity with longitudinal 
research tools presently at the "cutting edge" of methodological 
innovation. , 

Presented in Appendix A is a prospectus representing the contents 
of the entire .manual as it is currently envisioned. Negotiations to 
secure a commercial publisher are curfently underway and will be com- 
pleted soon. ITie investigators have also completed a major part of 
the introductory and overview material to be included in the commercial 
volume. ; Appendix B includes a list of project related papers by the 
investigators that were developed during the course of the contract 
period and credited accordingly. • • 

We wish to acknowledge the work and ideas of several people who 
helped to make this project possible. In addition to various erstwhile 

11 



and present personnel o£ the National Institute o£ Education whose • 
helpful advice was greatly appreciated, we are appreciative of the advi 
and counsel of our colleagues here in the College of Human Development 
at The Pennsylvania State University concerning potential contributors 
and pertinent, references.. Perhaps most importantly, our collaboration 
vrith the contributors 'tk this report was not only enjcSyab^e and pro- 

... \ : i ■ ■ ■ ' ' 

"ductivenJut. also educational for us: _ 

A great deal of. gratitude is also due our project staff. Our 

graduate assistants, especially Steven w'. Cornelius and Allison Okada 

Wollitzer, not only offered valuable iiitellectual input but were 

•extremely helpful in tracing down references and assisting with 

V • ... 
editing. T. J. Winand 'and Richard L. Erwin of the Institute for tlie 

Study of Human Development helped us repeatedly in the management of 
resources. An expression of profound appreciation is due several 
very capable project .and divisional- secretaries and typists who 
assisted at various stages on the project, including: Sally Barber, 
Diane Bemd, Jo Ann Christina, Kathy F. Droskinis, Kathy Hooven, 
Miriam Landsman, Joy Lose, Patty Senior, and Irigrid Tarantelli. 
To all of these and others whom, we may have neglected to mention — 
thanks ! 

, May, 1976 

John R. Nesselroade 
^ ^ * Paul B. Baltes 
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Ab stract 

A general developmental model for considering interindividual differences, 
intraindividual differences, and intraindividual change is presented. The 
model consists of defining each of the latter concepts in terms of Person X 
Variable X Occasion data and considering their interrelationships • Two major 
psychometric concepts. Stability and regression, are then singled out for 
special consideration within the aodel. The latter tack provides for some 
useful conceptual distinctions, wherB several different kinds or aspects of 
both stability and regression become readily apparent. In this way, the 
developmental researcher can become more self-conscious of, arid achie^-e greater 
clarity of, some key psychometric issues which undoubtedly will intrude upon 
his theory and practice. 
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I. INTRODUCTION 

The mission of this brief chapter is to present the beginnings of a 
unified conceptual framework from which to view traditional psychometric 
concepts such as stability, regression, reliability, and measurement error 

t ' . 

within a developmental context. In addition, the emphasis will be upon the 
•multivariate situation- -accommodating the notion of repeated measures through 
time on multiple variables for several individuals. Critical in the model to 
be presented are the concepts of interindividual differences, intraindividual 
differences, intraindividual changes, and" their interrelationships. To the 
extent that developmental psychologists should focus on intraindividual change 
and interindividual differences in intraindividual change (Wohl will, 1970, 
1973; Baltes, 1973), then there is a real need to consider within developmental 
methodology the interface between such concepts as intraindividual change and 
inter- and intraindividual differences, and traditional psychometric issues: 
Thus what follows is an exer^se in concept methodology rather than in formal 
jnethodology. In this way, the practicing developmental psychologist may 
acquire a firmer grasp of some of the psychometric concepts necessary for • 
carrying out valid developmental research in the multivariate situation. 

II. OVERVIEW OF THE GENERAL DEVELOPMENTAL MODEL- . 
In 1974 I proposed a general developmental mpdel (Buss, 1974a) which 
attempted to integrate the concepts of interindividual difArences, intra- 
individual differences, and intraindividual change within a multivariate 
developmental perspective. The major focus at that time was upon data-gathering 
strategies and data analyses rather than on traditional psychometric issues. 
In order to prepare the ground for a consideration of the latter, a biief 
overview of the 1974 model will be undertaken at this time. Note at the outset 
that the general developmental model proposed by Buss (1974a) is not identical 
with the one advanced by Schaie (1965) in the context of age-cohort research- 

\ 11 



A. Multiple Values on One Dimension " • / 

The basic general developmental model a la 1974 involved taking Cattell's 
(1946, 1952) three-dimensional Person X Variable X Occasion covariation chart 
as a basis for defining the concepts of inter individual differences, intra- 
individual differences, and intraindividual change and there interrelationships. 
Figure 1 presents the simple case, where the datum in each '^ell is an indi- 
vidual's score on a variable at a particular occasion. "yin, this model, inter- 
individual differences are defined by sampling across individuals, for each 
variable at one occasion; intraindividual differences are defined by sampling 
across variables for each individual at one occasion; and finally, intraindivid- 

ual changes are- specified by sampling across occasions for each variable for 
• % 

one individual. 



Insert Figure 1 about here 



3. Multiple Values on Two Dimensions 

Figure 2 extends the concepts of interindividual differences, intra- 
individual differences, and intraindividual changes by considering the six 
possible ways of comparative sampling across each of the xhree dimensions* 
That is to say, for each of the three dimensions, the simple case is indicated 
in which at least two values, components, or "ids" (Cattell, 1966) are sampled 
across each of the remaining two dimensions or sets. The six cases thus' 

generated are: (a) interindividual differences in intraindividual differences, 

* If 
in which individuals are compared in terras of sampling across variables at ,one 

» . > -* 

occasion; '(b) intervariable differences in interindividual' differences, m^^ 

* 

which variables are compared in terras of sampling across individual^ at .one j..^ 
occasion; (c) interoccasion differences (changes) in intraindividual differences 



AC 
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The three cases generated by sampling across each 
of the three dimensions of individuals, variables, 
and occasions are interindividual differences 
(Inter- ID), intraindividual differences (Intra-ID), 
and intraindividual changes (Intra-IC), respectively, 
(frbm Buss> 1974) 
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in which occasions are compared in terms of sampling across variables' for one 
individual; (d) mtervariafc^le differences (or intraindividual differences) in 
intraindividual changes, in uhich variables are' compared in terms of sampling 
across occasions for one individual; (e) interindividual differences in intra- 
individual changes, in which individuals are compared in terms of sampling 
across occasions for one variable; and finally, (f) interoccasion differences 
(kanges) in interindividual differences, in which, occasions are compared in 
terms of sampling across individuals for one variable. 



Insert Figure 2 about here 
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' Each of the above six data-gathering strategies is defined by what is 
compared— which gives the first aspect or the interindividual differences, 
intervariable differences, or interoccasion differences part— and in terms of 
^hat set is sampled across—which gives the second part of interindividual 
differences, intraindividual differences, or intraindividual changes aspect> 
The two interoccasion comparison cases (see c and f above) may be considered 
as changes through time. It may be appropriate to consider the (d) case as 
intraindividual differences in' intraindividual changes, since different 
vari^les are cojjtpared in terms of intraindividual changes. This observation 
reveals that there are two distinct ways of operakonalizing the concept of 
intraindividual differences in Figure 2: by sampling, across variables for oni 
individual at one occasion (a and c) and by comparing variables in terras of 
sampling across occasions for one individual (d) . Similarly, there are two 
distinct views of interindividual differences: by sampling across individual 
for each variable at one occasion (b and f ) , and by compearing individuals in 
terms of either sampling across \ariables at one occasion (a), or by. sampling 
across occasions for one variable (e) . 

14 • . • 
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Figure 2 The six cases generated by comparative cross-sampling 
for the simple case in which only two components from 
one dimension are compared in terms of sampling across 
a second dimension are shown. (Abbreviations for terms 
are as follows: ID=individual differences, IC=indiviciual 
changes, VD= variable differences, and OD=occasion 
differences.) (from Buss, 1974) 
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Each of the six cases in Figure 2 is iMustratecT by comparative sampling 
for two ids, although the more general case would iiivolve an entire two- 



dimensional matrix. The latter situation would" make use of the exact same 
data from an- Individual X Variable matrix at one occasion, but in (a) one 
would first get an overall measure Ce.g-, a variance measure) ^of variable 
differences within each> individual (intra^individual differences) and compare- 
individuals (interindividual differences In 'intraindividual differences) in 
terms of variances, -while In (b) one would first get a variance measure of ^ 
differences between^ndivilduals for each variable (interindividual differences) 
aind compare variable varianpes (inte|vari-able differences in interindividual ^ 
- differences) :/^&t4sHH!ldis,*a similar situation exists for the remaining^ 
four cases in Figure 2. • - . ^ 

Since the '(a) and (b> data-gathering strategies are carried out at 'dne'^ 
occasion, .they are'not particularly useful for addressing developmental aspects 
of changes'in variable score;5,^ unless one simultaneously considers the third 
dimeii;si-on of occasions (see below). " In contrast, the remaining four data- 
-gathering strategies', whicK.JLnvolve, in part', sequential dependent measures or 
changes in variable scores through time, would be especially useful develbp- _ 
mental paradigms.. In considering- the two cases ^ (d) 'and (e) , which are samples 
across the occasion dimension and are thus concerned with intraindividual 
changes, one must focus on comparing either );ariabi;s (d) o'r individuals (e), 
•and this requires that the unit for analysis be the plotting of the entire set 
of variable scores through time. A useful statistical technique that could be 
., employed here would be testing for trends. This focus on the pattern of 
changes' in variable scores may be contrasted with the. other four cases, in 
which the unit of analysis for making comparisons would be variances. In the 
(a) case, for- example, where interindividual differences or comparisons are 

V 
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made with respect to intraindividual differences, thp-^-^^opriate index for 
the latter is a measure of the wi thin-person variance of variable scores at 
one occasion. In order to compare variables at one occasion in terms of 
interindividual differences (b) , again it is a variance measure that captures 

the extent of the interindividual differences. A similar situation holds for 

\ ■ . ■ . • 

cases (c) and (f ) . • - * 

Variable scores are typically standardized across individuals 'for each 
variable at one occasion. This common practice needs to be avoided in the 
present scheme, since it would result in identical variances for each variable 
'at each occasion (the variance of a standardized variable is equal to unity) . 
If such. a standardizing procedure were adopted, it would be impossible to 
detect intervariable differences in interindividual differences (b) . By a 
similar argument, it would be undesirable to standardize each variable across 
occasions for each person, each occasion across variables for each individual,- 
etc. What is necessary for meaningful comparisons for all' six cases is to 
standardize. each variable in terms of both individuals and occasions, that is, 
across each rectangular "slab" or matrix for each variable. In this way, 
spurious, identical interindividual dif»^s variances for each variable at 
each occasion, which are brought about by tSaling procedures, are avoided. 
One of the advantages of standardizing in the manner being recommended here is ; 
that Absolute changes in variable scores result in correspondingly higher or 
lower standard scores, since variables are not restandardized within each 



occasion. • . • 

C. Multiple Values, on Three Dimensions 

> It is possible to extend each of the six data-gathering strategies outlined 
above in that situation in which one also samples through-the third dimension. ; 
In other words, there is a three-step process here, in which one first samples 
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across the first dimension, compares such sampling in terms of the ids or 
components on the second dimensions (the six cases just outlined above), and 
then proceeds to sample the comparisons of cross-sampling through the third 
dimension* In $he complete three-step procedure, two dimensional "slabs" or 
matrices are compared. This process generates six cases, in which those data- 
gathering strategies in Figure 2 are now moderated by a term referring to the 
third dimension that is sampled through. 



Insert Figure 3 about here 



Figure 3 illustrates the complete three-step procedure for the simple 
case an which two ids (which have been sampled Across on .one dimension) are 
successively compared across the third dimension. The more general case would 
involve successive sampling of entire matrices through the third dimension. 
As' before, the latter procedure could involve the same data for vWious cases, 
but it is the operational sequence of the three sampling steps that determines 
^ the six separate relational systems* . - ^ 

The six, three-step ca^s in Figure '3 are the following: (a) interoccasion 
differences (changes), in interindividual differences in intraind'ividual differ- 
' ences^ in which the variances reflecting the extent of intraindividual differ- 
ences for each individual at an occasion are compared for individuals through 
time or the occasion dimension; (b) interoccasion differences (changes) in 
intervariable differences in interindividual differences, in which the variances 
Reflecting the extent of interindividual differences for each variable at an 
occasion are compared for variables through, time or the occasion dimension; 
(c) interindividual differences in interoccasion differences (changes) in 
intraindividual differences, in which the variances reflecting the extent of 
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Figure 3 -- The six cases generated by sampling the labeled 
comparative cross-samplings through the third 
dimension are sho\^n. (The simple case is indicated 
in which only" two cross-samplings are successively 
compared through the third dimension.' Abbreviations 
for terms are as follows: ID=individual differences, 
IC=individual changes, VD=variable differences, and 
OD=occasion differences.) (from Buss, 1974) 
12 
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intraindividual differences' for each occasion for an individual are compared 
for occasions through the individual dimension; (d) interindividual differences 
in intervariable differences (intraindividual differences) in intraindividual 

• changes, in which the plots of variable scores across occasions at an individual 
are compared for variables through the individual dimension; (e) intervariable 

":. differences in interindividual differences in intraindividual changes, in 

which the plots of variable scores across occasions at a, variable are compared 
for individuals through the variable dimension; and finally, (f) intervariable 
differences in interoccasion differences (changes) in interindividual differences, 
in which the variances reflecting the extent of interindividual differences 
for each occasion at a variable are* compared for occasions through the variable 

dimension. . *" 

Although these extended- six data-gathering strategies may appear quite 
complex prima facie , acquiring a firm conceptual understanding of them may be 
- facilitated by working backward through the three steps and, consequently, 
their verbal designations. For example, in the case of interoccasion differences 
in interindividual differences in intraindividual differences, the focus is . 
initially on the extent of intraindividual differences in variable scores at 
one occasion and for one individual as reflected by a variance measure. If 
one were then to proceed to compare such variances for two individuals at one 
occasion, we would arrive at the two-step concept of interindividual differences ^ 
in intraindividual differences. Considering now the third dimension of occasions 
in which individuals are -now compared through time (occasions) in terms of the 
extent of intraindividual differences in variable scores, arrive at the 
three-step concept of interoccasion differences in interindividual differences 
in intraindividual differences. One may work backwards in a similar fashion 
for' each of the six extended cases in order to fully grasp their conceptual 
significance. ,^ 

t : - , ■ 
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The IB dJ*ta-gathering strategies for interindividual differences, intra- 
individual differences, and intraindividual changes are summarized in Table 1 

\ • 

Insert Table 1 about here 



in the order presented above, in which the, first three cases consider multi- 
•ids on only one dimension, the next six cases on two dimensions, and the^-last 
six cases on all three dimensions. 

■ . t ^ . - ■ 

D. Limitations of the Model " . . 

Before lea\^ing the general developmental model per se for a consideration 
of some key psychometric concepts within its framework, a few cautionary 
-comments are in order. Fir st,^he model makes the assumption that the meanings 
cf the constructs which the variables are measuring remain invariant across 
time. In other words, it is quantitative rather than qualitative or structural 
change (e.g., see- Baltes § Nesselroade, .1973; Buss, 1974b; Nesselroade, 1970) 
which the model is capable of addressing, and it' is therefore confined to 
slices of the* lifespan where the invariahce of bne*s constructs has been 
demonstrated. ' > 

A second limitation related to the above is that the present model i5 not 

r 

focussed upon an analytic treatment of interbeh^vioral change. That is to 
say, the strength of the model lies in those situations where change is monitored 
within a given variable or variable^ rather than marking out inte^-behavioxal 
changes involving cross-variable paths through time. The latter would also 
require techniques capable of analy^-ing qualitative change. A third, and once 
again related, limitation, serves to 'place the entire model in prof)er perspec- 
tive. This point can be best appreciated by contrasting the model and its 
intent with related notionis. 
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Table 1: Data-Gathering Strategies for Interindividual Differences, Intraindividual 
Differences, and Intraindividual Changes (From Buss, 1974) 



Dimension 1: 

S amp L C ttV. tsj 9 9 


Dimension 2: 

^VJUip<U C Ull 


Dimension 3: 
ssriDle throuffh 






Type 




Individuals 


No 


No 


Inter- ID 








Variables 


No , 


No 


Intra- ID 








Occasions 


No 


No 


Intra- IC 








Variables 


Individuals 


No 


Inter- ID 


in 


intra- ID 




Individuals 


Variables 


; No 


Inter-VD 


in 


inter- ID 




Variables 


Occasions 


. No 


Inter-OD 


in 


intra-ID 




Occasions 


Variables 


No 


Inter-VO 


in 


intra- IC 




Occasions 


Individuals 


No 


Inter- ID 


in 


intra- IC 




Individuals 


Occasions 


No 


Inter-OD 


in 


inter-ID 




Variables 


Individuals 


Occasions 


Inter-OO 


in 


inter- ID 


in intra-ID 


Individuals 


Variables 


Occasions 


Inter-OD 


in 


inter-VD 


in'lnter-ID 


Variables 


Occasions ^ 


Individuals 


Inter- ID 


in 


inter-OD 


in intra-ID 


Occasions 


Variables o 


Individuals 


Inter- ID 


in 


inter -VD 


in intra- IC 


Occasions 


Individuals 


Variables 


Inter-VD^ 


in 


inter- ID 


in intra- IC 


Individuals 


Occasions 


Variables 


Inter-VD 


in 


inter-OD 


in inter- ID 



Note Abbreviations are the following: ID = individual differences* IC » individual 
. changes, VD • variable differences and CD ■ occasion differences. 
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Mention has already been made_o £Cattell's (1946, 195 2)_originaJL three- 



-dimensionar covariation chart. The purpose of that model was to set out the 
six different factor analytic techniques defined by what was correlated (persons, 
variables, or occasions) over what (one of the tv;o remaining options after the 
initial selection) . In the expanded version of the covariation chart into a 
generic data box Cattell (1966j has gone beyond his initial desire to set 
out various methods of factor analyzing Person X Variable X Occasion data and 
has employed a full 10 dimensions for indexing a datum. Important to note in 
the present context is that Catteir's more recent treatment of ^data relations 
is not confined to specific data a^ialysis techniques. Inq)licit in his dat*i 
box is the notion that different data analyses are appropriate for different 
aspects or relational systems. In the Context of longitudinal data analysis 
tecrmiques, Kowalski and Guire (1974) have explicitly linked specific analytic 
techniques' to various relational aspects of Person X Variable X Occasion 
data. In contrast to Cattell' s (1966) comprehensive treatment of how one can 
conceptualize data.in general, and in contrast to Kowalski and Guire's (1974) 
•general account of the various analytic techniques available for longitudinal 
data, the present model is restricted to conceptualizing specific concepts 
'(inter^^ and intraindividual differences, intraindividual change) withih the 
three-dimensional data frame. Its intent, therefore, is to foc'^s in upon a 
specific set of concepts as these are related to longitudinal data. The 
present model makes no attempt- to explore terrain previously charted out by 
Others'. 
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III. PSYCHOMETRIC CONCEPTS AND THE GENKRAL 
" \ - 
\ ' DEVELOPMENTAL MODEL : STABILITY 

the. tlwo psychometric concepts singled out for specific treatment in terms 

of the mulltivariate developmental situation and the preceeding model are 

stability |and regression to the mean. Other concepts, such as reliability, 

aieasurement error, true scores, etc., are introduced as needed and as they are 

related| specifically to stability and regression, 

A. Stability in Two Dimensions 

By stability in the multivariate developmental situation, one can mean 
either the stability of differences between or within persons through time. 
In considering Figure 2, these two cases translate respectively into noting 
either the degree of stability of interindividual differences scores on a 
single variable through time (case f ) , or the stability of intraindividual 
differences scores on a single person through time (case c). 

In each of these simple case?, multiple values on one dimension (either 
individuals or variables) for orfe id (either a variable or individual) are 
obtained on two successive occasions. The simple two-occasion situation would 
involv^e calculating a correlation coefficient as the stability coefficient, 
whereas the multiple occasion situation would involve calculating successive - 
stability coefficients (see below). Since the Pearson product moment correla- 
tion restandardizes scores at each occasion, that is, it cancels out means and 
variances, this statistic would permit inferences concerning the degree of 
stability of the pattern or shape of the multiple scores through time. Thus, 
it would be possible to have absolute changes in scores, yet obtain a h.gh 
stability coefficient so long as there was relatively high invariancc of the 
pattern of interindividual differences through time. It can be noted in 
passing that t^e ceiling of a two-occasion product moment stability coefficient 
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would be the lower reliability coefficient as determined by assessing reliabil- 
ity at each occasion; 

An alternative index of i>tability that takes more than just the con- 
sistency of shape into account would involve one of the measures of similarity 
based upon distance (see B0I2, 1972, for a review of such indices of similarity) 
Cattell's (Catteil et al., 1966) pattern similarity coefficient is probably 
the superior statistic in that it simultaneously considers differences between 
two patterns of variable scores due to: elevation (the mean of all scores in 
aXprofile), scatter (the square root of the sum of squares of the deviation 
scofes about the mean), and shape (the residual information after equating two 
patterns for both elevation and scatter). " In addition, the pattern similarity 
coefficient is readily meaningful--varying between 0 (no pattern similarity) 
and +1 (perfect pattern similarity), and it has known distribution and a test ^ 
for significance (Horn, 1961). 

If one were to employ the pattern similarity coefficient as a two-occasion 
index of stability of either interindividual differences or intraindividual 
differences,, it would be necessary to standardize across each rectangular 
"slab" or maf-ix for each variable as previously outlined. In this way, one 
can make the best use of the additional measurement properties of the pattern 
similarity coefficient, that is, its sensitivity to ^differences in both the 
means and variances of two patterns. Thus, the pattern similarity coefficient 
should be used ao an index of the stability of inter-or intraindividual differ- 
ences when the concern is for absolute rather than relative pattern invariance 
"over two occasions. 

B. Stability in Three Dimensions ^ 

Tne above notions of stability can be readily generalized to the three 
dimensional situation, that is, where it is desirable to make variable compar- 
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isons in the stability of interindividual differences, or, person comparisons 
in the stability of intraind-ividual differences. Each of these cases in the. 
two-occasion situation can be visualized by reference to Figure 3. Variable 
comparisons in the stability of intc.-individual differences involves case 
*(f)— where it is extended through the third dimension of Variables such that 
variable differences in stability coefficients are observed. The sarce rationale 
follows in making person comparisons in the stability of intraindividual 
difff.'rences, which involves extending case (c) in Figure 3 through the third 
dimension of Individuals. In either of these two cases, the product moment or 
pattern similarity coefficient may be used, depending upon the question being 
asked in light of the unique properties of each of these statistics as previously 
disciissed. 

Thus far the concept of stability has been ex.tended to both inter-and 
intraindividual differences in the multiple variable and person situation. 
However, a truly adequate treatment of stability in a multivariate developmental 
context must provide for more than the restrictive two-occasion model. Extend- 
ing cases (f) and (c) in Figure 2 right across occasions to involve an entire 
matrix or "slab," illustrates successive or multiple occasion data-gathering. 
Thus in case (f), successive stability coefficients for a single variable 
could be obtained, where each stability coefficient Is calculated from adjacent 
occasions. The values of the stability coefficients could then be plotted for- 
purposes of variable comparisons in .trends over time, and Figure 4 illustrates 
^ three prototype cases: increasing stability (IS), stable stability (SS), and 
decreasing stabil^ity (DS). By ^lising curve fitting' techniques, one may then 

* 

determine variable differences in "Stability trends through time. The exact 
same logic may be applied to case (c) in Figure 2, J^hpre Figure 4 may now be 
regarded as illustrating three protot>npe stability functions for intraindividual 



I 
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differences. Each function, then, characterizes a particular individual 
rather than a particular variable. The term "prototype" in the latter situation 
is more than a mere casual use of labels, since it may indeed be possible to 
distinguish "types" or clusters of persons on the basis of stability functions 
for'intraindividual differences. 

Insert Figure 4 about here 



*What about the interrelationship between the degree of stability of 
inter individual differences and the degree of stability intraindividual 
differences, where the same data are analyzed in the appropriate manner? High 
stability of interindividual differences on each of th^ variables is a prereq- 
uisite for high stability of intraindividual differences for each person, and 
vice versa. In other words, in the extreme case (i.e., considering the stability 
of thejsntire Variable X Individual matrix through time), both the stability 
of inter- and intraindividual differences are two different ways of looking at 
the same phenomenon. However, the direct translation between the degree of 
stability of inter- and intraindividua^l differences evaporates as soon as one 
selectively focuses upon a subsample of variables or persons through a limited 
nijmber of occasions. The latter statement, of course, does not deny the ever 
present nonindependence of the stability of inter- and intraindividual differ- 
ences when calculated from the same data. 
C. Stability of Population Parameters 

Having distinguished between stability of inter- and intraindividual 
differences, there remains another important sense of the term "stability" 
applicable to the multivariate developmental situation. Thus, one may speak 
of the stability of various variable properties of a population through time, 
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where the focus is now upon the 'degree of stability of certain descriptive 
statistics, such as the mean or variance. Clearly, in this case, one would not 
restandardize'the, variably scopes at each occasion, since this would mask 
changes in absolute valu6 ,of the mean and variance. In mapping out various 
statistical'properties of -variables over time, it is quite possible to have 
stability of, .say, the mean and- variance, yet^ at the same time, have radical 
instability of inter- and/or intraindividual differences. 

The distinction being made here is conceptually quite important, since 
the stability or "dynamic equilibrium" of a population on a particular variable 
does not entail stability and/or systematic change at the individual level. 
To the extent that in multivariate developmental psychology there should be an 
emphasis upon intraindividual change and interindividual differences in intra- 
individual change (e.g., in the present context, the degree of stability of 
intraindividual differences and person differences or interindividual differences 
in the stability of intraindividual differences) , then it is important to make 
the kind of distinction presently being made. This is not to say that questions 
concerning the stability of properties of a population on a particular variable, 
or the stability of interindividual differences through time, may not be 
extremely interesting or important.. Rather, and this is the basic point, 
there are several ways one can frame questions concerning stability in the 
"multivariate developmental situation, 'and the practicing- researcher should be 
quite conscious of the Various alternatives available and effect an adequate 
match between the research question and the coficept of stability employed. 

IV. PSYCHOMETRIC CONCEPTS AN_D THE GENERAL 
DEVBLOPMENTAL MODEL : REGRESSION 
A. Regression as a Prediction Model versus Type of Change^ 

Regression towards the mean is a thorny issue in developmental psychology. 
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and, although it has been discussed within a developmental context (e.g., 
Baltes fi Nesseiroade, 1976; Baites, Nesselroade, Schaie, § Labouvie, 1972; 
Clarke, Clarke, and Brown, 1960; Furby, 1973), there remains a need for further 
clarification,. Any discussion of regression must, of necessity, consider such 
psychometric concepts a^ measurement error, reliability, true scores, and so 
on. In discussing regression within a developmental context, it is advan- 
tageous, as suggested by Baltes & Nesselroade (1976), to separate the typical 
psychometric, issue associated with this term, namely, regression as a prediction 

model, from observed regression in the data. 

•i 

I The pj^eviously outlined developmental model of Buss (1974a) can be fruit- 
fully consulted in attempting to keep separate regression as a prediction 
model and observed regression in the data. Thus in Figure 2, regression as a 
prediction model can be best located in terms of case (b), where one would 
employ regression techniques for predicting scores on one variable from scores 
on another variable. Regression in this .instance is not "in" the data, or in 
other words, is not a "real" phenomenon. 

In order to better understand the point I am trying to make here, consider 
case Cf) in Figure 2, where measures are obtained on the same variable on two 
separate occasions. In the latter instance, there is continuity over time, 
and if there is regression from occasion to occasion, it is a phenomenon 
intrinsic to these data. In other words, and this is the basic point, when 
regressing one variable against another different variable, we are using 
regression as a prediction model. IVhen we obtain repeated measures for two 
occasions on the same variable, regression toward the mean, if it occurs, is a 
phenomenon to be explained. In the latter situation, regression toward the 
mean is a special kind of change 'in one's data. Should one desire, variable 
differences in degression as a type of change can be located in the general . 
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model by considering case (£) through the third dimension, that is, as i^Uustrat- 

ed in Figure "3. ~ 
* In the following. discussion, regression as a prediction model is bracketed. ^ 
The focus of attention is exclusively upon th^t situation where observed 
regression i-s in the data (regression as a type of change) in order to try to 
clarify some of the developmental issues in this area. 
B. Regression of Extreme Samples . 

Observed regression to the mean may be associated with either changes in 
true scores or changes in error scores in the^clas^ical measurement model of 
X = t + e, that is, the observed score is the sum of a true score component 
and an error score component. Important to note, then, is that observed 
regression, .which is in the data, may or may not reflect true changes in the 
underlying trait or variable of a particular sample. 

The developmental psychologist must, in certain situations to be explicated, 
take account of observed regression associated with the error part of scores^ 
in order to make valid inferences concerning real or true score change over 
time. The classical case \i)^ere the developmental psychologist simply^ ^nust 
consider the extent to which ols^served regession towards the mean is associated 
with true changes in the variable is illustrated in Figure 5 (see also Baltes 
§ Nesselroade, 1976; Furby, 1973). 

In Figure 5, the sample of individuals is initially selected from the 
extreme range of the normal distribution of the population. We can make the 



Insert Figure 5 about here 



assumption in Figure 5 that measurement . error exists and is constant across 
occasions, that is, reliability is invariant. As the second occasion, the 
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Figure £ The classical situation of regression towards the ^ 
population mean, where the sample is initially 
selected from the extreme range of the normal 
distribution of the population. 




entire sample has shifted' closer to the population mean u. To the entent that 
the rellvbility of variable x is less than unity, that .is, there is some 
measurement error, then there will be observed regression associated with 
changes in error scores. This follows from the classical measurement model— 
a model that forms the^. bedrock of measurement theory— and a model which must 
>be accommodated until displaced by something shown to be. superior. 

The classical measurement model states that (because errors of measurement 
are assumed to be uncorrelated over time) extreme scores in a distribution are 
biased in that same extreme direction, and that on a second occasion, . the 
error associa'ted with these individuals' scores will, on %he average, be 
less-rthereby effecting observed regression towards the population mean. 
Another way of saying this is that in nonerror-free measures, observed scores 
are biased estiraatps of true scores, where observed scores above the population 
mean are biased upwards, and vice versa for observed scores below the population 
meanl 

, For the developmental psychologist who is working with a select sample of 
nonerror-free extreme scores, regression toward the mean associated with 
changes in error scores will occur. It will show up as observed regression, ' 
all other things being equal. To the extent that 'there are true changes in 
the underlying trait or construct which a variable is tapping, this may effect 
no observed change in the sample distribution if the tyue score and error 
score changes, on the average, cancel each other out. Thus, the developmental 
researcher, when working with a sample under conditions described above, must 
know from where the sample came, as well as the reliability of measures, in- 
order to make valid conclusions as to the extent of t;rue score or "real" ^ 
changes in the underlying construct over time. The latter conclusion is not 
the consequence of a specific prediction model, but is the consequence of a 
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very general measurement model underlying all measurement— psychological or 
otherwise. 

In regard to integrating the concept of regression within the present 
methodological model, we can -note that, in that ideal case of error-free 
measures and v{here regression is associated with changes in true scores and, 
for arguments sake, the Pearson product moment 'stability .coefficient is unity, 
then in the shift towards the 'population mean in Figure 5 there will 'be no 
interindividual differences in intraindividual change. The latter would be a 
very unlikely situation in any actual research outcome. More probable would 
be observed interindividual differences in intraindividual change towards the 
population mean associated with either 'real or/and spurious factors, respectively 
paralleling true score and error score changes. 

■ '' ' 

C. Regression of Representative Samples 

There is another, quite different, situation involving regression toward 
the mean, and previous discussions have failed to place it in sharp contrast 
. with what is most typically meant by regression (but see Baltes" 5 Nesselroade, 
1976) . On occasion there has even been a tendency to confuse the two situations 
of regression, or at least switch from one to the other without adequate 
awareness . 

The second major case of regression toward the mean is illustrated in 
Figure 6 where, in this instance, the sample distribution can be considered as 
representative of a population rather than coming from a selective region of 
0 the population distribution as was previously the case. In Figure 6 there is 
observed regression towards the mean, but in this instance, regression is 
defined by a reduction in the sample variance rather than a shift in the 
sample mean (and thus the sample) towards the population mean. Thus, in 
Figure 6 the m^ans at each occasion are identical yet there is within-sample 
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regression towards the mean, and within-population regression to the mean to 
the i\teni the sample is representative of a population. As before, such 
obseLed regression may be associated with changes in either true scores or 
changes in error scores. However, in this second case of regression, any 
regression associated with changes in error scores is due to increased reliabil 
ity across occasions and a reduction of the error variance---which was not .the 
case in the first instance of'regression where it was assumed reliability was 
constant over time. Of course, in considering only changes in error scores, 
both within-sample regression to the sample mean and regression of the sample 
to the population mean could occur' simultaneously in Figure 5 if there were an 
increase in reliability over time. 



Insert Figure 6 about here 

In Figure 7 it can be seen that mean sample changes in either an upwards 
or downwards direction are independent of within- sample regression to the 
mean. Thus the entire distribution of scores may shift in either direction- 
regression still being defined, as a reduction in vc-riance. The latter observa 
tidft brings us to the point that, in the multiple occasion situation, changes 
in regression to the mean may be mapped via noting changes in variance through 
time. However, this conclusion reveals that observed regression is "merely" 
observed change in a specified direction, although there is more to it than 
that. The observed change may be associated with changes in either error 
scores (reliability) or/and true scores, and valid developmental conclusions 
require separating these two sources in both types of regression discussei in 
this section. 
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Figure 6 — Regression towards the population and sample mean^ j 
where the sample is representative of the population, | 
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^ Insert Figure 7 about here 

d.- Concluding conunents on Regression - . , 

\Vhile is is true that .within-sample regression may or may not occur — 
4ep8nding upon whether there is a reduction in error variance and/qr real 
changes in true scores towards the mean— --egression of observed scores, as 
discussed in the first instance and illustrated in Figure 5, will occur, 
assuming nonerxor-free measures and all other things being equal. Develop- 
mental psychologists will need to sLbsess any true score change in the sample 
mean either towards or away from the population mean in light of error score 
change. 

Recently, Baltes and Nesselroade (1976) have concluded that regression 
•toward the mean is often an irrelevant issue in developmental research to the 
extent that we should focus upon change and multiple occasion data beyond the 
two-occasion case. According to them, regression is only one form of change 
rather than some immutable law and in multiple occasion data, it can be assessed 
' via error-centered baseline comparisons. This view has much to recommend it, 
since it places the typical two-occasion regression situation within a broader 
framework for the multivariate developmental researcher. Such being the case, 
the spirit of tlveir effort is consistent with perspectii^es developed here. 

' t 

The concepts of interindividual differences, intraindividual differences, 
and intraindividual change were defined in terms of sampling across one of the 
three dimensions of individuals, variables, and occasions, respectively. Each 
of these concepts was then considered in comparative sampling by introducing 
a second dimension, thus generating six data-gathering strategies. Each of _ 
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Figure 7 Regrossion towards the sample. mean but not towards 

the population mean in two different, situations: change 
in an upwards direction (UD) and change in a downwards 
direction (DD). 
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the latter six cases wa$ extended to include the third dimension -through which 
* • 

the comparative sampling is sampled. Out of the total 15 data-gathering 
strategies considered, 11 vtexe defined in p&rt by the occasion dimension and 
arc therefore capable of dealing'with change data. ^ . ^^.^ 

Limitations of the general developmental model were discuBsed. These 
included: (a) the model rests upon the assumption that the meaning of the 
constructs which the variables are' measuring remain invariant; (b) the model 
is not equipped to deal in an analytic way with interbehavioral change; and 
finally, (c) the model is to be used for focussing upon a specific set of 
concepts as these are related to longitudinal data, rather than for attempting 
a general and comprehensive deliniation of various developmental data analysis 
techniques. 

• Having outlined the general developmental model and its limitations, two 
important psychometric concepts were considered within the developed framework: 
stability and regression. Two kinds of stability were outlined which were 
defined by two of the three dimensions of persons, variables, and occasions: 
(a) the stability of interindividual differences on a single variable through'" 
time; and (b) the stability of intraindividual differences on 'a single per^nr 
through time. Stability in thxee dimensions involves extending each of^these 
types of comparing stability coefficients acrobS variables or persons respec- 
tively. 

Stability can also involve multiple occasion data; where su€:cessive ^ 
stability coefficients are calculated at each occasion for_ determining changes 
in stability of either interindividual differences on one variable, or intra- 
individual differences for Qne^ perlon. One could then make variable .^r ^ 
person corapai^ops, respectively, of trends in stability functions. Finally, 
staWlity of population parameters was another aspect considered, where it was 
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pointed out that one could plot the values of 'certain descriptive statistics' 
over occasions. This meaning of stability reveals the important conceptual 
point that, it is quite possible'" to have stability. of,, say, the mean and ^ 
variance of -a population, yet ,^ at the same time, have radical instability o£ 
'inter- and/6r intraindividual ^differences.' , ' \ 

In cbnsidering regression toward th'e mean, ' twQ fundamental types welre 
' defined within the general'developmental 'model: .(a) regression as a prediction 
model; and (b.) regression as a kind of change. The former was seen as Essen- 
tially nondevelopmentai; irid thus discussipn was confined to regression as a . 
special kind of change over ti'me. . , • ' V — r" 

Two Kinds of regression toward the mean as change were considered for the 
two occasion case only: '(a) " regression of- extreme samples; and (b) regression 
of representative samples". Regression of extreme sample means td populatioji ' 
•means was seen- to occur given the assumptions of the classical measurement 
model and all other things being equal. To the extent that there are changes . 
in the true score component o'f. observed score- th^s will effect the amount of 
observed regression which would otherwise be due solely to changes in measure- 
mefit error over occasions. Regression of representative samples of particular 
populations was seen to involve a decrease in variance over time rather than 
changes in sample means. Thus there qan be t decrease in' sample variance (and 
thus regression towards the mean) brought about by! changes in either the true 
' scores and/or the error scores. The-mean may or may not change over time-- 
regression in this case being independent of such change. • ■ • 
^ In conclusion it should be noted that greater clarity of psychometric 
concepts in the developmental situation j.s possible and necessary for those 
practicing the craft of developmental res'earch. The proposed formulation of a ^ 
• general developmental model irtvolving interindivldual differences, intraindi-" . 
vidual differences, and intraindi vidual change is helpful in. this regard. 



Footnotes , v ■ 
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^Some of those considered are the following: curve fitting, ^factor analysis 
multivariate analysis of variance, polv-ncmial' growth curVe models -regression, 
time series, etc. 
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ABSTRACT 

In this paper we explor'e the consequences o£ particulai stage linkage 
Structures for the evolution of a population! We first argue the importance of 
constructing "dynamic" models of developmental theories and show through a 
series of examples the implications of various stage connections for population 
movements. In discussing dynamic models, one thrust of our cpmments is to 
identify the sorts of process features about which assumptions must be made in 
- order to convert a static theory about stag^ connections (the sort of specifica- 
tion commonly presented in life-span psychology) into a dynamic model. A second 
focus of our discussion concerns inverse problems: how to utilize a model 
formulation so that the stage linkage structure may be recovered from survey 
data of the kind collected by developmental psychologists. 
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■* MATHEMATICAL REPRESENTATIONS OF DEVELOPMENT TOEOR^IES ' 
" .1. INTRODUCTION 

Although time, usually -ivfi the guise of age, is a crucial variable in 
developmental psychology, it is the case that formal models of developmental 
phenomena r art; ly have the character of dynamic representations, in the sense of 
mimicking, the evolution of an empirical process through time. The analytic 
procedures' employed most extensively by life-span psychologists are factor 
analysis, regression, analysis of variance, scaling, clustering, and variants 
of these methods (see, for instance, Nesselroade § Reese, 1973). These are 
powerful techniques for identifying variables that are central to the course of 
development in a particular substantive area (e.g., intellectual maturation, 
.acquisition of moral values). Also, when applied to panel data, the procedures 
can yield insights into how the salience of key-variables shifts over the life 
cycle, or over- a portion thereof (e.g., stages in infancy, youth, adulthood). 

These analytic method, do not, however, lead to dynamic formulations of 
developmental theories, which can be useful in testing predictions from a 
theory about the evolution of an empirical process, or in comparing the implica- 
tions of competing explanations. By a dynamic formulation we mean a representa- 
tion which incorporates into the mathematics the main assumptions about a 
developmental phenomenon and is specified in such a way that the relevant 
variables, and their postulated interrelations, are functions of time or subject 
age. In this sense, like the empirical process, it too constitutes an evolving 
system. As a simple illustration of such a model, consider the following 
statements of alternative evolutionary mechanisms: 

(A) The growth of a process at each instant is proportional to its 
potential for future growth. 
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(B) The growth o'f a process at each instant is proportional to the 
product of its current size and its potential for further growth. 

These statements might be proposed as competing explanations of the 
manner by which information is diffused in a population of size N. In formu- 
■ lation (A;), it natters not how many persons y(t) know the information of 
concern at instant t; only those yet to hear, jiumbering N-y(t), are salient to 
the diffusion rate. If the information were propagated by a mass media source, 
such as radio or television, rather than by interpersonal coramunicatjon, this 
model might apply. Fonmilation (B) , in comparison, is consistent with a process 
in which those already aware of the information "infect" the uninitiated through 
contact and conversation. Assuming that the informed and the uninformed mix 
randomly, the variable governing the evoifition of the pro^ss would be y(t) [N- 
y(t)], which measures the rate at which individuals from the two groups come 
into contact. 

The evolutionary mechanisms, (A) and (B) , can be represented by the 
differential equations (I.l) and (1.2), respectively, 

kj[N-y(t)), y(0) = 0 (I.l) 

k2y(t)(N-y(t)], y(0) ^ 1 (1.2) 

wherek, and k_ are constants which adjust for the time unit (e.g., day, year) 
used in the measurements.^ Equations (I.l) and (1.2) have for solutions (1.3) 

and (1.4), -k t 

y(tO = N(l-e ^ ) (1.3) 



y(t) = — 



Nk,t 



Nk t - (1.4) 

N-l+e 



'which predict the different evolutionary paths displayed in Figure 1. 
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Figure 1 about here 

These -formulations are "dynamic" in that time appears explicitly as a 
variable; they are process "models" in that the predicted value of y(t) evolves 
according to the assumptions of a particular theory. If a researcher has data 
on the time course of an empirical process, he could test whether equation 
(1.3),- (1.4), or a specification of aii equivalent sort best approximates ha,s 
observations. By this exercise it is often possible to select among competing 
• explanations of the mechanism underlying a developmental process. .Indeed, 
these very models have been applied by Coleman, Katz, and Menzel (1957) to data 
■on drug adoptions by physicians (also see Coleman, 1964, pp. 43-45). They 
concluded that the drug acquisition pattern by socially integrated ^^D's is best 
repre:iented.by a logistic curve (implying mechanism [B]), while isolated MD's 
adopt according- to the constant source model (mechanism [A]), as they are 
influenced principally by drug advertisements in trade journals. To our know- 
ledge, " although developmental psychologists emphasize ontogenetic processes and ^ 
emplpy the imagery of an evolutionary system, few attempts have been made, to 
translate their theories into formal models of the above sort. 

In this paper, we describe the formulation of dynamic models where the 
objective is to test developmental .theories against data or ascertain the con- 
sequences of particular assumptions about the structure of a process. To 
delimit our task, we focus on the sort of mathematics that is appropriate for 
studying qualitative change. As a result, the tools we introduce are pertinent 
to theories which postulate stage sequences, a variety of explanation with 
considerable precedent in developmental psychology (Piaget, 1960; Kohlberg, 
1968'; Ausubel § SuMivan, 1970). To the degree possible we have written this 
■ paper with a view toward substantive issues and have concentrated on the 
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Figure 1^ Illustrative Growth Curves for Diffusion via Social 
Interaction rnd Ditfusion from a Constant Source . 



= population size; y(t) = number aware of the information 
at time t* ' 
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tTanslation of theoretical specifications into inather.atical formalism; the. 
reader usually is referred elsewhere for mathematical details and estimation 
procedures* The organization of the paper is as follows: In the next section 
we introduce a class of models that is suitable for studying evolutionary 
propesses which incorporate the notion of stage. In section III we describe 
how particular stage theories can be cast in the framework of the general 
model. In section IV we relax several requirements of the basic model so that 
it can more realistically represent developmental phenomena, 

II. THE CONCEPT OF DEVELOPMENT STAGES AND A MATHEMATICAL 
FORi^fULATION OF -STAGE PROGRESSIONS 
Stage sequences have been postulated for a variety of developmental processes 
the evolution of moral behavior (Kohlberg, 1973), cognition (Piaget, 1954), 
personality (Loevinger, 1966), and motor skills (Shirley, 1933), to cite but a 
few topics. There also exist diverse formulations of stage models in the 
literature of life-span psychology. These differ with respect to the presumed 
sources of the stages and with regard to the rules governing movement between 
them. In regard to stage origins, some authors have emphasized maturational 
considerations, in which individuals are viewed as programmed genetically for 
particular behaviors or abilities to emerge (Gesell, 1954). The specification 
of 4)sychosexual stages, keyed to biological activation of the sex glands, 
provides an illustration (Kohlberg, 1973, p. 181). Others view stages as 
arising from interactions with the social environment: Kohlberg (1968, pp. 
1016-1024), for example, contends that experience with the cultural and physical 
world is necessary for cognitive stages to take the shapes they do. STtill 
other researchers have adopted the position that stages are a useful research 
construct around which to discuss development, without insisting that they have 
an empirical existence (Kaplan, 1966; Reese, 1970). 
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We shall not discuss further the very important issues concerning the 
etiology of stages, but will focus instead" on the mathematical representation 
of theories about stage connections and on the consequences of various linkage 
structures* for the evolution of individuals aro^g the stages. Formulations of 
"stage connections in a developmental process differ according to whether the 
progression- is viewed as unilineal or multilineal, whether stages in the 
sequence can be skipped, and whether regression to an earlier level is possible. 
A second set of considerations pertinent to the structure of developmental 
theories concerns the age specificity of a stage and the related matter of the 
variability of duration in a stage. For discussions of these topics in the' 
context of particular substantive processes, the reader is referred to Emmerich 

(1968) and Kessen (1962). 

To develop the mathematical apparatus for ascertaining the implications of 

particular stage connections, we discuss both the simplest prototype of a stage 

2 

theory (for concreteness) and 'the general mathematical formulation. Consider, 
■then, a developmental progression consisting of n stages, in which* the linkage 
is unilineal and there is no possibility of stage skipping or regression. An 
example"of such a structure, with n equ^l to 5, is presented in panel A of 
Figure 2; henceforth this model is refe^ed to as example j. It will be conven 
ient to also have available a matrix representation of the stage linkages. For 
an arbitrary n-stage structure, we define a matrix M, . . 

11 "-12 •••••• "> 
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M = 



In 



"21 



m 



2n 



m 



'nl 



m 



nn 



* (11. 1) 
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whose .slem^nts are m. . = {probability of transferring from stage i to stage j 
when'a transition occurs}. where.Q:-<-m ; < 1, and^ " m = 1. -These restrict- 
ions on the elements of M ensure that each row. of the matrix constitutes a 
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probability distribution. Ke require, in addition, that f 0 "for-each stage 
i which is not an absorbing state of the process; that is, frou which individuals 
can exit. This means we exclude the possibility of within-stage transitions,^ 
a type of move which is undefined in most developmental, theories. Also, we set 
in.. = 1 for each stage which is an absorbing state of the process. This is 
done for mathematical convenience and, as we shall see, carries no substantive 
implications. In the particular case bf the unilineal progression (Figure 2, 
panel A), we have the further requirements on M: = ^> ""ij ~ ^ ' 

otherwise (except that m^^ = 1). This matrix, M'j^, is reported in panel B of 
Figure 2. 



^ , Figure 2 about here 



To this point, 'though matrix M conveys important 'structural information 
about the process, the description of the stage progression is a static repre- 
sentation. To elaborate the model we must indicate 'Tiow stage transition 
events occur. At a general level of description we assume that the time 
speiit by an individual 'in stage i follows some probability distribution, 

Prob.(Tj^<c|T^.....Tj^_l) (11-2) 
' where t ,...,t, report the sojourn tines in earlier -stages. Our imagery,' 
therefore, is the following. An individual originates in stage i at the begin- 
ning of the process, = 0. ' He remains there for an interval t^, specified by 
a distribution function Prob. (T.<t), and then transfers} to stage j with prob- 
ability m^^ . He remains in this stage for a period r^, specified by a condi- 
tional probability distribution Prob. Ct2<t | t^) ,\h«ii transfers to stage- k with' 

probability m., ; and so forth. The process continues until some absorbing 
jk 

state is reached, at which p^int the evolution is terminated. The time path 
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a. Diagram of Stage Linkages 
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). Motrix RepireseniatiorP of the Stage Linkages^ 
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Figure 2-- Representation of a Simple Unilineal Stage Structure. 



^Each row of is a vector of destination probabilities. Thus, 

if an individual were in fetage one before a transition, the row one 
entries would pertain and they indicate movement to stage two with 
probability equal to 1. • 

^The«main diagonal entries are set equal to zero (with the 
exception of row 5) to indicate that a '*move" is not defined apart 
from a stag'e transition; i.e>, there is no notion of movement within 
a stage. TlVe main diagonal entry of Tow 5 is set equal to 1 because 
this stage is an absorbing state (Mg^ = 0 for j 5^ 5) and the definiti 

of m,--see "text--requires Em . = 1. 
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for the unilineal progression associiated with the stage linkages of: matrix 
is f)resented in Figure 3. *' 



Figure 3 about here 



Several further assumptidns are necessary- to complete the specification off 
the model. One .matter concerns the relevance of an individual's past movement 
history to the course of his subsequent evolution among the stages. We assume, 
(i) knowledge of current stage conveys all information that is relevant 
to forecasting future movements. 
Stated technically, if m.-^^i, ^ = {probability of moving from stage i to 
stage j at the occurrence of a transition, given prior sojourns in stages a, 

b,...,f}, then 

m..,^=m. .-' 
i],ab...f 1] 

(This assumption is superfluous in the current example of a unilineal pro- , . 
gression since there is only one possible path, but it is relevant,.to the 
evolution of a population in less restrictive models.) We indicate in the next 
section that this specification has been employed in descriptions of stage^ 
linkages in developmental psychology. 

For an initial baseline class of models, we further assume, 
(ii) the sojourn time in stage i is exponentially distributed: that is, - 
Prob^(Tj,<t|-j,. . .,Tj._p = Prob^ (Tj^<t) 

= F.(t) = 1 - e'^'' (1^.3) 
Use of the exponential distribution amounts to specifying that the probability 
of departing from stage i during the infinitesimal interval (t, t+dt) . condi- 
tional on being in stage i at time t, equals 
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STAGE 




P^g"^'^ 2"' Sample Path Description Corresponding to trie Uniiineal 
Stage Structure of Figure 2. 



It is assumed that there are five stages, which must be traversed 
sequentially, is the value of a random variable and denotes the 

sojoui.i tinje for an individual in stage i. Stage 5 is an absorbing 
state o£ the process. 
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-A.t 

f-(t)dt A.o ^ dt 

J = r— = X.dt 

-X.t 1 

l-F.(t) l-(l-0 ^ ) 



where f^(t) is the density function corresponding to F^(t). This result, in 
turn, indicates that the probability of leaving stage i is independent of 
duration in the stage, and is tantamount to specifying an absence of aging, so 
new entrants have the same likelihood of departing as individuals who have been 
in the stage for some period of time. The parameter, X., incidentally, has an 
interpretation as the rate of movement out of stage 'i; consequently, 1/X^ equals 
the expected duration in stage i. 
Finally, we require that 
(iii) if the data pertain to the movements of a population, rather than to 
the transitions of a single individual, the population is homogeneous 
with respect to the structure of the evolutionary process. 
This does not mean that all persons have the same duration in stage i, but 

that T. , the time spent in stage i by individual c, follows the single expo- 
ic 

nential distribution F.(t) = 1-e"?^^. Stated less formally, duration in a 
stage is a random variable with the und<^rlying distribution of holding times 
the same for all individuals. Similarly, where alternative destinations are 
available to persons in stage i, homogeneity means that all have the same list 
of probabilities for making the various transitions, not that they move ident- 
ically. 

. It is worth dwelling on the conceptual status of the preceding assumpt- 
ions. The Vestion of the structure of M is a familiar topic to developmental 
psychologists, since stage theories are commonly specified at this 
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"■level.' Assumptions (i) to (iii) can be viewed as "side conditions," aspects of 
the process to which researchers have generally not been sensitive, though see 
Kessen (1970) and Emmerich (1968) for provocative comments on precisely these 
mattens. l\'ha't is made evident by formulating a dynamic model is that development 
theorists must address these auxiUary questions if complete models are to be 
specified. .The particular assumptions we have made constitute a gross simpli- 
fication of. reality; this is especially true of specification (ii), which 
postulates an absence. of duration effects, and specification (iii), which 

postulates population homogeneity. These assumptions do, however, provide a 
• I * 

convenient starting point from which to consider more realistic formulations, 
whiich are developed in the next sections. 

We aow wish co convey the implications of as^^umptions (i) to (iii) for the 
movements of individuals among the stages. We denote by p^j(t) the probability 
that an individual iiv stage i at time 0 moves to stage j by time t. (This 
pr(|bability differs from m^^ in that ,the latter refers to movement proclivities 
at the occurrence of a transition, not over wideiy spaced time intervals.) 
With this specification in hand, the evolution of a population among the stages 
is described by the system of integral equations, 

-A.t t -X.u 
P..(t1=6.e ^ +r. />.e ^ m.,p, .(t-u)du ' (n.4) 

0<^i, j<n 

wherfe^S.^ = 1 if i = j, and 0 othenvise. This expression, know-n as the back- 
ward- equatio'ns for a continuous -time Markov process (Feller, 1971, p. 484), is 
amenable to the following interpretation: (1) When i ^ j, P^j (^) consists of 
the sum of products of three factors: the probability of a first departure 
from stage i at time u, the proba!)ility of a stage i to stage k transition at 



50 

ERIC 



that instant, and the probability of transferring to stage j by some combination 
of flioves in the interval t - u. The suaaation is over all intermediate stages ' 
k and over all time divisions u in the interval (0, t) . (2) When i = j , in . • 
addition to the above term, there is the possibility of not transferring out of 
stage i during (0, t). This probability is given by the first term. , 
If we represent by P(t) the matrix of elements p^ - (t) , 



P(tl = 



PiiCt) 



Pnl^^) 



P (t) 
^nn^ 



0 < p. -Ct) ^- 1. 2:p. .(t) = 1, then the integral equations (II. 4) have the con- 



venient solution. 



P(t) = e 



A[M-I]t 



P(0) 



(II. 5) 



In this representation A is a diagonal matrix. 



A = 



whose entries are the reciprocals of the expected duration times in each stage, 
I is the identity matrix, and M is the array specified in equation (II. 1) which 
describes the pattern of movement between the stages. Further, by the expression 
e^, A an arbitrary square matrix, we mean the power series in A, 
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n 



n=0 Til 



(II. 6) 



which can be evaluated by standard-numerical methods (see e.g. Gantmacher, 1960). 

It is usefiU\to recapitulate what is accomplished by this mathematical 
formulation. The nlatrix P(t) relates the distribution of a population among 
stages at time t to tts distribution at time 0, in the sense that a typical 
entry, p^ ^ (t) , conveys\the probability of moving from stage i to stage j during 
the interval (0,.j. The model is "d>-namic" in that P(t) is a function of time; 
with the passage of time, P(t) describes the evolution of the population among 
the stages. Equation (11;. 5) shows how the matrix Pit) is built up from the arrays 
M and A. However, while this equation is useful as a calculating formula, the 

logic of the process is conveyed more adequately by the integral equations (II .4) . 
To illustrate this model in the setting of a simple unilineal progression 

(matrix of Figure 2), we must specify average waiting times in stages 1,2,3, 

and 4. We assume these to be .5, 1, 2, and 5 years, respectively. Consequently, 

we have for matrix A, 
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(11.7) 



where the choice of is arbitrary. Since stage 5 is an absorbing state, the 
notion pf waiti(ig time to a departure has no meaning. Mathematically, [M - I]^^ 
[m - I] = = 0> so bears no influence on the calculations.) Now, 

from^lj. A, and I, we have 



A(Mj - n 
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(11.8) 



Fox the illustrative times t = 1, 2, and 4 years, we obtain, from (I I. 5) for 
P(t), * ' 
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stages, subject to the assumptions about the process structure detailed above. 
The entries p^j (t) refer to proportions'^ of the population who have moved 
between particular stages in the relevant time interval. For ex^le, according 
to the entries in the top row of P(l), if observations are taken oi^e year 
apart, we would expect 13 percent of the population in stage 1 at time 0 to 
still be there, 46 percent to have moved to stage 2, and 33 percent to have 
reached stage 3. By comparison, over a four-year interval, less than 1 percent' 
would remain in stage 1, 48 percent would have reached stage 4, and 19 percent 
would be in the terminal stage of .the process . 

The results from the three calculations reveal that, even thQugh the 
progression is unilineal with all individuals characterized by tlje same para- 
meters, if observations were taken on the population at two time points, t=0 
and t=tj, the array^P(tp might be interpreted as evidence for a more complex 
theory, such as one permitting stage skipping or population heterogeneity in 
the rate or pattern of movement. Further, the correspondence between the 
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matrix constructed from the population locations at two time points, P(tp, and 
the rule governing stage transitions, M^, decreases with time. Thus, different 
researchers observing the same population at two time points, but with different 
spacing intervals, might draw contrary conclusions about the stage linkage 
structure even though the single mechanism, of Figure 2, governs its evolution. 
Oaly with a formal model of the process could one hope to uncover its underlyiri; 
structure. 

III. MODELS 0£ MORE ELABORATE STAGE THEORIES 
The matrix M contains structural information about stage linkages. Since 
theories of development aie commonly posed at the level of specifying this 
array, flexibility in incorporating a variety of particular formulations would 
appear to be an important feature of a general framework for describing evolu- 
tionary behavior. In this section we focus on the issue of translating stage 
theories into M-matrices, and illustrate the evolution of P(t), the transition 
matrix for a population based on its locations at times 0 and t, under alter- 
native specifications of M. As we have noted, auxiliary information about the 
process, concerning the distribution of waiting time intervals and the form of 
population heterogeneity, is required for a full description of a dynamic 
' model. In the next section \;e therefore elaborate upon these ''side conditions" 
"^nd outline ways in which our initial assumptions can be relaxed. 

No technical difficulties arise in reformulating the continuous-time 
Markov model to accommoJate more elaborate theories of stage linkages than the 
structure in Figure 2. We illustrate the procedure with a few examples^. 

2. A unilineal progression which permits stage skipping - The formulation 
of such a structure is diagrammed in Figure 4, panel A; its translation into an 
M-matrix is reported in panel B. Tlie principal new feature is that, supple- 
menting the deterministic sequence of Figure 2, it is now possible to move 
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directly from stage 2 to stage 4 and from stage 3 to stage 5, when transition 
out of the relevant origin location takes place. We musn also specify the 
probabilities of following the alternate paths. ' In the present example, lacking 

information as to the relative magnitudes of the various probabilities, we 

• f 

assume all destinations to be equally likely; that is, we prescribe m^^ ^ 
= -.5, and m = m = .5.- In practice, estimates of the transition probabilities 
would be assigned on the basis of theory or from observation on 'the empirical 
process , 



Figure 4 about here 



Using matrix together with the A array of equation (II. 7), whose 
entries describe the rate of raovem^t by individuals out of each stage, we 
obtain for P(l) and P(4), from equation (II. 5): 
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These P(t) arrays are the transition matrices a researcher should expect to 
observe if the stage locations of individuals are surveyed one year" or four 
years apart, assuming that the population evolves according to the linkage 
specification M2 together with the auxiliary conditions outlined in the preceding 
section. The entries are different from those obtained with the simple 
unilineal progression (equations II. 9 and 11.11), yet the same pattern of zero's 
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Diagram of Stage Linkages 

'' 




Matrix Representation of the Stage Linkages^ 
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Figure Representation of a Unilineal Progression in which 

Stage Skipping is Permi.tted. 



^AU destination 
assumed to occur with 
additional details on 



stages corresponding to 
equal probability. See 
interpretation of NL. 



an origin location are 
note? to Figure 2 for 
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and non-zero's is present, and without a formal model of the evolution of the 
process a researcher would be unable to predict the different implications of 
these structures. 

3. A unilineal progression with stage skipping and the possibility of 
r egression . We now Superimpose on the linkage structure the possibility of 
reverting to an earlier stage. This arrangement is diagrammed in Figure 5, 
panel A, in which we have provided for the possibility of backward flows from 
stage 2 to stage 1, from stage 3 to stage 2, and from stage 5 to stage 4. The 
M-matrix corresponding to this model is reported in panel 'B. Again, where 
multiple destinations correspond to an origin stage, we have arbitrarily assigned 
equal values to the m^^'s. There is one atiUitional alteration in M^, in compar-. 
ison with the M-matrices of earlier examples. Because there now exists a 
possibility of regressing from the t*minal stage to an earlier level, m^^ ^ 1. y 
To maintain our conceptual imagery, in which wi thin-stage transitions are 
undefined, we set m^^ = 1 and m^^ = 0. Note that the former value does not • 
imply a high rate of departure from stage 5, since the rate of movement is^ 
controlled by X^. ^ It only means that all transitions from stage 5 are directed 
to stage 4. 



Figure 5 about here 



To obtain P(t) we use and A in conjunction with equation (II. 5). Here 
the element X^^in equation (II. 7) is no longer arbitrary, as movement out of 
stage 5 is a possibility. We shall assume that such reversions are rare, and 
hence specify the average waiting time to a transition from stage 5 to be eight 
years; that is, = .125. With these assumptions, we obtain for our illustrative 
calculations at t = 1, 4: 
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Diagram of Stage Linkages 




Matrix Representation of the Stage Linkages^ 
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Figure 5-- Representation of a Unilineal Progression in which 

— ' Stage Skipping and Regression to an Earlier Level 

arc Permitted. 



^AU destination stages corresponding to an origin location 
aro assumed to occur with equal probability. See notes to Figure 
for additional details on interpretation of M . 
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If we compare the PCI) matrices and the PC4) matrices fifom the three 
examples [i.e., equations (II. 9), (III.l)-, Cin.3), and CH-H), (nr.2)-; and 
(III.4)], we can acquire a fair idea of the implications of different stage 
interconnections for the evolution of a population among the statuses. We- also 
emphasize the, fact that if a population were surveyed at two time points, 
especially widely spaced time points, it" may not be obvious ffom inspecting the 
empirically determined transition array, P(tp, as to the structure of the 
stage linkages (matrix M) which generated the observations. will return to 
the issue of identifying the correct structure and recovering matrix M when the 
observations on a process are widely spaced; first we conclude thi§ discussion 
on translating theoretical specifications of stage linkages into M-matrice? \ 

with a couple of examples of multilineal sequences that have been described in 

the developmental psychology literature. 

4. A divergent multiple progression (Van Den Daele, 1969, Figures 2, 4). 

This stage linkage structure has the diagrammatic representation of Figure 6, 

panel A; its corresponding M-matrix is presented in panel B. Because stages 4- 

7 are specified to be terminal states of the process, the corresponding rows of 
have I's in the ..ain diagonal. Van den Daele provides no discussion of 

waiting time distributions to departure from the various stages; hence the 

model remains incomplete as an evolutionary process. 
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Figure 6 about here 

5* A convergent multiple progression (Van Den Daele, 1969, Figure 2). 
This stage sequence is depictejd in Figure 7, panel 'A, and its associated M- 
inatrix is 3;^orted iii panel B. In this instance, the structure consists of a 
collection of deterministic unilineal progressions, the specific sequence for 
an individual being contingent upon his entry stage. Note al^o that the 
assumption of irrelevance of past history, which is posited in this formulation, 
is one of the side conditions we have required (assumption [i] in the preceding 
section). In particular,, this specification appears in the fact that knowledge 
of the patji by which one has reached stage 5 (or stage 6) is of no value in 
fdjrec^sting," OT understandings an ifidividual' s subsequent movements. Van Den 
Daele (19G9) discusses several additional models of stage linkages; such as 
"partially convergent, divergent progression," and "partially divergent, 
convergent progression." As the procedure in converting flow structures into 
M-matrices 'should be evident ?t this point, discussions of these specifications 
are not presented. 



Figure 7 about here 



To recapitulate, subject to several side conditions, we have shown that it 
is possible to construct formulations of a range of developmental phenomena 
which mimic the evolutionary character of the observed process. With such a 
model one can forecast the movements of a population among the stages. By 
carrying out the requisite cal.culations for different specifications of the 
stage linkages, and comparing the predictions, it is possible to ascertain the 



c 



Diagram of Stage Linkages 




b. Matrix Representation" of the Stage Linkages 

0 1 0 0 0.0 0 

0 0 0 .5 .5 0 0 

0 0 0 0 0 3 .5 

0 0 0 10 0 0 

0 0 0 0 10 0 

0 0 0 0 0 10 

0 0 0 0 0 0 1 



Figure 6-- Representation of a Divergent Multiple Progression' 



^Source: Van Den Daele (1969, Figures 2, 3). 
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b. Matrix Representation of the 'Stage Linkages' 
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Figure 7-- Representation of a Convergent Multiple Progression . 



"bource: Van Pea Daeie (iS69, Figuro 2). 
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ways in which rather complex theories produce divergent implications and 
-design testing schemes which maximize the possibility of rejecting one or 
another formulation as a description of the empirical process. Of equal 
importance, it is often possible to work backwards, starting with observations ^ 
on the stage locations of a population at a few widely spaced time points, and 
derive the structure of the stage linkages .compatible with the data. 

An inverse problem. Until this point we have assumed that observations 
have been made on an empirical process in a way such that M and A can be estimated 
directly from the data, or that theories are available which specify the values 
of their entries^ We then sought to derive the evolution of the process subject 
to the presumed structure- In developmental psychology, it is not uncommon for 
a researcher to have many observations on a few individuals (e.g., Pisget, 
1954). Such a data collection scheme approximates "sample path information," a 
complete history on movements and waiting times of the sort illustrated in 
Figure 3. Detailed observations on a few subjects is a research strategy not 
without its costs, however. One learns little about the frequency of rare 
events (e.g., regression to an earlier stage, stage skipping, rare development 
paths) and acquires only the most rudimentary knowledge about the variation of 
duration times in a stage. It is therefore not surprising that investigators 
who rely on this approach tend to be oriented to uncovering universal rules 
(e.g., Piaget, 1960) rather than to elucidating individual differences and 
ascertaining the variety of developmental patterns. 

Partly because of the limitations of small data sets, it is becoming 
increasingly common to employ survey met^ods, in which a large population, , 
sometimes thousands of individuals, is observed (or intexrogatwd) at a very few 
■ time points (e.g., Baltes 5 N'esselroade, 1972). The spacing intervals in 
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such panel studies are usually wide, often one or more years elapse between 
interviews, so it is not unusual for some subjects to have made multiple moves 
while others have made one or zero shifts between stages. The transition 
matrices which can be constructed directly from such observations are PCt>- 
arrays, rather than M-arrays, and the stage linkages may not be readily dis- 
cernible. Indeed, determination of the movement structure which underlies the 
evolution of the population can be 'a difficult task. 

One approach to ascertaining the stage linkages from survey data involves 
consideration of the "inverse problem" td the mathematical formulation of the 
evolutionary model (equation .11.5). Stated formally, we have available the 
matrix PCt^). constructed from observations on the stage locations of individuals 
'at times 0 and t^. The typical entry in this matrix is P^jCtp = nij^h^'^^i.' 
where n^ = {number of individuals in stage i at time 0} and n^^(t^) = {number 
of persons who started in stage i at time 0 and are in stage j at time t^}. We 
wish to inquire whether it is possible to recover a unique M-matrix for the 
process and, where the answer is affirmative, we wish to estimate this matrix. 

The first step in solving le inverse problem is to take the logarithm of 
both sides of equa.tion (II. 5). 

Q = AIM-I] = ^ in P(tj) (111.5) 

Just what we mean by the logarithm of matrix P(tp, the conditions under which 
a solution to equation (III. 5) will exist, and the circumstances under which 
the solution will be unique, are complex issues which are discussed at lei gth 
in Singer and ^pLlern:an (1>76). Assuming we can obtain a valid and unique Q- 
matrix from thc^e calculations, a second task, separating M from A, still 
remains. In nmy instances, though, this matter is of little concern, since 



the pattern of zeros and non-zeros in Q and M I will be identical and develop- 
ment theories are often posed* at the level of identifying permissible transitions. 
Moreover, because zeros are typically present -in many main diagonal cells of M 
in models of 'developmental structures, a complete or near complete separation 
between M and A can frequently be effected. 

We conclude this section with an example of the calculations associated 
with the inverse problem. Suppose'observations taken on a population at times 
0 and t^ have produced the transition matrix. 
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Such data would appear to be consistent with a variety of evolutionary mechanisms. 
From inspection of P(tp we do know that regression to some earlier stage must 
be possible; otherwise all entries below the main diagonal would be zero. 
Little else about the structure of M, however, can be inferred from inspection 
of P(tp. Indeed, because of the sizable non-zero elements in most cells of 
the matrix, a researcher might conclude that direct transitions arc possible 
between mc .t pairs of stages. 

If we arc willing to assume that matrix P(tp was generated by a continuous- 

ACM-I) t 

time Markov process; that is, via the evolution of the structure P(t) = e , 
some matrices A and M which satisfy the definitional restrictions enumerated in 
connection with equations (IT.l) and (II. 5), we can sblve for W(M-I)t^ using 
equation (III. 5). This yields the array. 
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A(M - I)t 
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(in. 7) 



In this instance At^ and M can be separated by employing the following 
argument. From our earlier examples we know that a main diagonal element m^^ of 
M will equal zero if any off diagonal entry in the same row, m^^, is different 
from zero. According to equation (III. 7), each row of matrix M must have at 
least one non-zero off diagonal element; therefore m. . = 0 for all values of i. 
With this inforniation we can obtain At^ uniquely. 
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and solving for M provides the structure reported in Figure 8, panel A. The 
schematic representation of the stage linkages implied by is shorn in panel 
B, in which probabilities of the various' moves have been appended to the 
paths. 



Figure 8 about here 



The point to be eir.phasized is that it is not apparent from inspecting 
matrix P(tp in equation (111.6) that the underlying stage linkages are those 
reported in Figure 8, nor would any static analytic procedure be likely to lead 
a researcher to the correct cop^^lusion. IvTiat is necessary is to construct a 
model of the evolution of the process and solve the implied inverse problem for 
the parameters which con:^?spond to the particular data set. (In the present 
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Diagram of Stags Linkages 




Figure 8. Stage Sequence Structure Implied by P(t ) in Equation (III. 6) 



^The process is assumed to evolve according to a continuous-time 
Markov formulation. 

^Entries indicate the probability of a stage i to stage j move 
when transition takes place 

^Probabilities of the various transitions aro attached to the 
appropriate paths. 
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example, we have assumed that the underlying model is a continuous- 
time Markov process [i.e., specification (i)-(iii: of the preceding section] 
and have solved for the matrices At^ and M which are compatible with the 
observed array P(tp, in that they would have given rise to this array if the 
postulated evolutionary process were- approximately correct.) 

IV. ALTERNATIVE S PECIFICATIONS OF THE SIDE CONDITIONS 
In this section we discuss relaxing two of the more burdensome spec'.fi- 
cations of the model, in the sense that they are likely to be inappropriate as 
characterizations of developmental processes. We first consider the require- 
ment that the duration intervals in a stage must follow an exponential dis- 
tribution [assumption (ii) of section II]. Following t^ese comnjents we turn to 
the requirement that the population be homogeneous with respect to the process 
parameters A and M [assumption (iii)]. 

More general waiting times than exponential . The exponential distribution 
is frequently employed in the literature of reliability theory to describe 
duration intervals in a system state (stage in the current application). It 
has the advantages of being mathematically tractable and approximating reality 
in situations where the probability of a state change is uninfluenced by aging 
or time in the state. For exaTiple, if the process states are "alive" and "not 
alive," then over the middle age ranges of many animal species, .the age-specific 
mortality rate is relatively constant and the duration intervals (in the "alive" 
state) are reasonably well captured by the exponential distribution. Similarly, 
when mortality results from exogenous events--accidents— the distribution of 
■ ages at failure can often be approximated by the exponential. 

In a great rrjny situations in social research, however, we know that 
proneness to changing state- it^ a function of duration. Tn particular,, this , 
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has been suggested with respect to residence location (McGinnis, 1968) and 
employment affiliation (Ginsberg, 1971). In these applications it has been 
argued that the duration-specific departure rate decreases with time, giving 
rise to the phenomenon of "cumulative inertia"- -the longer an individual 
remains in a state the less likely he is to leave in the immediate future. 
The substantive explanations for a declining departure rate involve the growing 
investment an individual has madf , with duration, in friendships (in the first, 
instance) and in seniority in his place of work (in the second) . There is no 
mathematical reason, however, to assume a declining departure rate in choosing • 
H.(t); and in other substantive contexts a different specification may be more 
appropriate. For a superb review of stochastic models incorporating the 
notioi of duration dependence, see Hoem, 1972. 

^ convenient way to generalize the Markov model to e^ccommodate a variety 
of duration-time distributions is to begin with the integral equation repre- 
sentation for transition probabilities. .Equation (II. 4) is a special case of the 
formulatio: 

t 

Pijt^^ = ^j^^'^i^^^^ " ^ 0 fi(u)'nikPi,j(^-")'^" (IV.L) 

0 _< i , j 1 n 

in which the terms are identical with those of the earlier equation except 
that f. (u) replaces the exponential density, X.e"^i", and F. (t) [the distribution 
function corresponding to f.(t)], replaces [l-e'^i^]. A theoretically appropri- 
ate choice may now be made for F. (t) . 

As an illustration, one candidate for F.(t), in the case of a declining 
departure rate, is the two-parameter family of functions 
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-X.t " 

Fj(L) = 1 - e ^ X^>0 ; 0<Y^<1 (IV. 2) 

Here the probability of departing from state i during the infinitesimal interval 
(t, t + dt), conditional on the process being in state i at time t, equals 

v.-i -x.\ 

f.(t)dt (X.Y.t ^ ) e ^ , Y.-l 

^ ^ ^ dt = X.Y.t dt 



l-F.(t) ' ■ Y. i i 

^ -X t ^ 



e 



Because of the restriction on Y-'in equation IV t ^ is a decreasing 
function of time, and the declining failure rate aspect of the distribution is 

evident. ^ . \^ 

The general formulation UV.l) for duration time distributions ^nd transit- 

\ 

ions between states generates a class of models kno\m as seVi-Markov processes • 
These generally do not have simple representations for the matrices P(t) 
analogous to equation (1 1. 5), and the solution of the system of equations 
(IV.l) requires numerical integration methods. 

Population hetero geneity . To this point we have assumed that the matrices 
A and M of equation (II. 5) are identical for all individuals. This does not 
mean that all persons move identically since the process is probabilistic; it 
does imply, though, that individual level characteristics are unrelated to the 
structural parameters of the process. In other words, homogeneity means that 
considerations of genetic makeup, intelligence, sensory stimulation, and other 
factors by which indi IdJal differ from one another do not portend distinct 
evolutiX)nary paths in the developmental process .under consideration. 

'VhcTC is rt-ason to believre, however, that individual differences are 
present in the- course of development in many processes (Werner, 1957; Kohlberg, 
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1968, .p. 1024). We therefore desire a formulation in which the movement 
pattern is parametrized in terms of variables ;s-hich differentiate among persons. 
To construct a general specification of heterogeneity within the conceptual 
framework of a Markov process, we assiuAe that, corresponding to equation (II. 5), 
the stage transitions by individual c have the structure 

A (M -I)t 

P (t) =.e 
c 

This formula indicates that 3ach person is characterized by a pair of matrices; 

A and M , and his evolution, in turn, is described by P Jt) . Thus, our form. 

c c I 

ulation begins with a separate Markov process for each individual. 

This approach directs a researcher to identify the variables which. describe 
heterogeneity; that is, to ascertain which factors account for individual 
differences in the matrices M and A. Thus, not only does a heterogerxeity 
formulation lead to more realistic models of evolutionary processes, in /that 
allowance is made for individual differences, but it stresses the analytic 
tasks of specifying the variety of developmental patterns in a population and 
ascertaining the attributes which make an indi^ridual more prone to following 
one set of paths rather than another. j 

One form of heterogeneity concerns the. distribution of M-matrices in a 
population. Focusing on these arrays serves to emphasize individual differences 
in proneness to making particular moves where a transition takes place. We 
shall not, discuss this form of heterogeneity in the present essay and direct 
the interested -reader instead to McFarlami. (1970), Spileirman fl972a) and 
Singer and Sp rman (1974). A second form of heterogeneity stresses individual 
differences in rhe A-matrix. i.e., in the rates at which departures occur for 
persons in the various states/ We conclude this. section with a simple formulation 
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of pgpulation heterogeneity in which it is assumed that the individual differ- 
ences can be expressed in the latter way. 

To simplify the discussion, we further require the non-zero entries in the 
diagonal matrix A to be equal for an individual; i.e., X. = X for all i. This 
means we are specifying identical departure rates from all states. As a result, 
equation (II. 5) reduces to 

P(tlX) = e^-^^"-^^ (IV.4) 

where P(tlx) denotes the transition matrix for an individual having a rate of 
movement value equal to X. We shall assume that equation (IV.4)- describes the 

evolution of an individual dra\m at. random from the population. 

Heterogeneity is incorporated into the formulation by specifying a density 

function gV>) which describes the distribution of X-values in the population. 

We now define the population-level transition matrix corresponding to times 0 

and t to be 



" txm-I^ (IV. 5) 

P(t) = / P(tlX)g(X)dX = / e*^^^" g(X)dX 
0 0 



This formula expresses the population-lev.l matrix as a weighted average of the 
individual-level arrays, P(tlx), the weights reflecting the population proportions 
associa-ced with particular X-values. 

•To" complete this specification of heterogepaity it is necessary to select 
a density Yun'otion g(A) to describe the distribution of X-values. One useful 
choice is the gainma family of functions: 

,a a-1 -3X (IV. 6) 

8(^) - La. - ? x>0 , u>0 , g>0 

1 (ct) 



which is flexible enough to describe a variety of unimodal curves. With this 
selection of gC>0. a convenient representation of the population- level matrix 



P(t)- is qbtained (Spilerman, 1972b, 
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P(t) = 
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(IV. 7) 



The transition probabi\ities (IV. 7) do not describe the evolution of a Markov 
process; however they do describe the movement of a population in Khi^h each 
individual follows a Markov model with individual differences being specified 

by g(X) in equation (IV. 6). 

In analogy with our earlier inverse problem discussion for Markov chains, 
the present formulation can be used with observations taken at widely spaced 
time points, 0 and t^, together with estimates of a and B to yield an estimate 
of the underlying transition mechanism M, according to the matrix equation 



M = 







1- s 
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(IV. 8) 



Thus, from.obser^-ations 6f the sort -.oliected in many surveys, even under an 
assumption of population heterogeneity in the rate of movement, it may be 
possible to recover the matrix of stage linkages which governs the evolution of 
the process. 

V. CONCLUSIONS AND SIJ>MARY 
In this piper we have explored the consequences of particular stage 
linkage structures for the evolution of a population. One thrust of our 
comments has b.en to iJeutify the sorts of process featufes concerning which 
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assumptions must be made in order to convert a static theory about 'stage, 
connections into a d>'namic model. A second *focus in our discussion has centered 
on inverse'problems;' how to utilize a model formulation so that the stage 
linkage structure (matrix M) may be recovered from survey data of the kind 
usually collected by developmental psychologists. 

We have, presented only the most rudimentary sorts of stage structures. 
Indeed, even within the Markov framework we have lihiitcd our consideration 1:0 
'a subset of these models; namely, those which are time-stationary (i.e.-, A and M 
are not functions of time). By this specification we have excluded the possi- 
bility of accomodating age-dependent transition laws, a consideration of 
' substantial importance in developmental psychology. (An extension of the 

models discvssed here to incorporate both age dependence and cohort .effects is, 
however, a feasible undertaking but one with an increase in matheipatical 
complexity.) Further, all the models we have discussed entail a" low dependence 
of future movements on the transition history of an individual, given his 
current hage^. Restrictions of these sorts are likely to be teasenable for 
some processes, unreasonable for others. Appropriate model? of developmental 
phenomena must, therefore, be constnictcd from a list known characteristics 
about 3n empirical process. 

We also point out that the concept -of stage merges with the notion of 
state as the number and sorts of permissible transitions increase. ."Stage" 
seems conceptually rooced to the idea of progress (i.e., development) and would 
be an appropriate component of a theory which sees the system's statuses as 
genetically determined or as facilitating the conditions for succeeding statuses 
to come into play.^ The mathematical framework we have introduced is also ' 
compatible with a "state" notion, in which there is an extensive opportunity to 
cycle among the statuses. State formulations have been su<;Rested in the 
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.psychology literature in relation to anxiety, moods, etc. (e.g., Kessen, 19^, 
pp. 72-73). 

As a final set of considerations in relation to the strxicture of stage 
models, we note that all the fomulations we have addressed are models of 
solitary processes. We have proceeded as if intelligence, cognition, motor 
skills, and personality development * unfold autonomously. In reality there no 
doubt x^xist extensive dependencies among some of these processes • Mathematical 
models of interacting developmental phenomena could be formulated but clear 
empirically-based specifications of such dependencies are still lacking- ^ 
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^The initial condition, yCO) = 1, in equation (2) is necessary because 
diffusion through communication cannot begin until at least one person is 
knowledgeable. 

^For a more technical presentation of continuous-time Markov processes see 
Feller (1968, Chap, 17) and Singer and Spilerman (1974). For discussions on 
the superimposition of theoretical structures on stochxstic models see Coleman 
(196-1, Chaps. 5,6). 

'^In the present example i, j, k = 1, 2, 3, respectively* 
^If the observations are on a single individual the interpretation of 
p_(t) is in terms of the probability of a st<-ge i to stage j move between 
times 0 and t. 

^The symbol over a matrix or over an element in a matrix, will mean 
*hat :t should be viewed as est:: mated directly from data rather than calculated 
from a rnarh^^ma tit^al model. 

u^rr,.. p.sv^^ ...'.moi^ 2: example 1 refers to the structure in 

Vhe time-stationary Markov formulations postulate irrelevanro of 
prior stage affiliations, durations in those stages, and duration in current 
stage. The last two of these restrictions can be eliminated by introducing 
non-stationar> semi-Markov mudeis as delineated, for example, in Hoem, 1972. 

^Stages in childlioud, :>uch as "walking" or "reading" expose an individual 
to entirely new. sets of experiences which may be prerequisites for the onset of 
more advanced behaviors. 
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Mathematical Description and Representation of Developmental 
Change Functions on the Intra- and Interindividual Levels 

I. INTRODUCTION 

In an earlier paper (Kowalski 5 Guire, 1974), we surveyed the. then - 
available data analytic strategies for several types of longitudinal data 
sets. In particular, we identified six distinct types of longitudinal data 
sets^ viz., (1) univariate time series, (2) uni\ajLiale one-sample data matrices, 
(3) univariate K-sample data matrices, (4) nultivariate time series, (5) 
multivariate one-sample data matrices, and (6) multivariate K-sample data 
matrices, and the methodologies appropriate for each of these types were 
treated separately. The present paper builds on this background, paying 
special attention to the mathematical description and representation of develop- 
mental change functiu 3 on the intra- and interindividual levels* An overview 
of the ai'ailable models and statistical procedures for the analysis of such 
data ^s prefsented. The ain of this present at ion is to identify certain proce- 
dures which have proved to be useful i.^ tAv biulu^i^^al, growth-oiriented sciences 
for possible application, in behaM-i^l Jci/L:lop.ae:ital research. In so doing, 
we must c;^refully consider potential d.'.:f-ren:os in the structure of the 
me4sureTicnts to be analy-ed md, whenever possible, models which do not require 
monotonicity and nonparoJiietric analog:: for the statistical procedures discussed 
will be cited. On the other hand; norp , research - both fjrom the standpoint of 
theory and from the standpoint of practice - needs to be done before we can 
confidently analyse multivariate tipta «;et^ in any field ot application fc.f . 
Kow;i1«;Vi 107.M -^o t^^t_ yr^rd'' of caution in ti^.s context should be tempered 
by the need for the entire dov elopT.ental research community to gain some 
experience m ti.c use of tl^.esu techrii^ues (Prahl-Anderscn fi Kowalski, 1973). 
It is i\\ this St^irit that this ,\ip:rr .s bitten. Beh'ivioral scienti "-s should 



be aware of the possibilities and limitations of statistical treatment of 
developmental data and the models presented uere chosen to illustrate both 
ends of this spectrum, at> well as many of the shady areas in-between. 

We begin with a general discussion of longitudinal data sets in the 
context of the design of Jcvelopnental studies. The purpose of this section 
is to place the longitudinal pproach into some perspective vis-a-vis the oft 
heard dictum that *'the design uf a study is a function of the purposes of the 
investigation'* and an attempt at delineating the class of studies for which 
longitudinal designs may be appropriate is made. It is recognised that develop- 
ment will often depend on factors other than simple chronological age, but it 
is argued that this does not imply that the class referred to above is empty. 
Since questions of this t>pe are considered in great detail in the first part 
of this book, our discussion is b^ief and somewhat cursory. It is included 
only in an attempt to counteract some of the impact of much of the recent 
developmental litcrat e which seems bent on condemning the longitudinal method. 
We then consider questions associated with the descriptive and explanatory 
study of ijitraindiv'idual s^hange. We focus on the implications of choosing one 
or another of the ncdel'^ uhich can be used for these pujrposes and thereby 
confront important pfii losuphxcal probleMS ranging from the making of reasonable 
a priori assumptions to the validation of a model by the expedient of subjecting 
it to a goodnesb-uf-f It tebt. Finally, we discuss techniques for the investi- 
gation of interindiv idual differences in development. We consider not only 
formal hypothesis testing techniqi ^s but also less formal, descriptive, data- 
analytic procedures vhich may prove useful in unraveling some of the complex 
problems asscviii-^d the measurement of change (Harris, 1963)- 

T 1 . {)[ SirNS FOR TOL STUDY^ 0^' PHV^-'I QPMFMT 
M.i.Ii ^.^liitnt thjnkmg in bjhavioral xv.ta.*h •^^ju-^li I'-.ij^i .-Ludy 

of dev^lop'^^*'^ Ljenc.ated by a seru? o^' nm^rs '^^y ^c^^-' o fl^^OS, 1970, 
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1972). In i96S, Schaie introduced a tri factorial developmental model which 
views development, D, as a furiLtion of A = chronological age, C = cohort and 
T = time-of measiuomenl. IV-rliaps the i^reatest contribution of this model was to 
focus attention the lupl ications it had for the choice of the design of 
developmental studies. In particular, schaie (1970) pointed out that (a) 
cross-sectional designs confound the age and cohort effects, (b), longitudinal 
designs confound the age and tiae-of-measurement effects and (c) time-lag 
designs confound the cohort and time-of -measurement effects. While these 
facts were apparent long before Schaie introduced his model, the model provided 
a convenient conceptual framework which clearly illustrated the source of 
these probler.s. In an attempt to rectify the situation, the general notion of 
a mixed -longitudinal dtsii;n u^i developed (Prahl -Andersen 5 Kowalski, 1973) 
and several special cises, vjz., the cohort-sequential, time-sequential and 
cross-scqucnciai dei=i.;n-i, '-ore identified and proposed for use in certain 
well-defined t^pes of dev.-lor.r.tntal investigations (Kohlwill, 1970). It was 
clear that Schaie viewed th-jse nixed- longitudinal strategies as completely 
rcph.cmg the :-or.- L.adUio.ial d.-iigns. Schaie (1972) was especially vociferous 
in conduTUirs r-d m.i! desij;rs, concluding that, "the single cohort longitu- 

dinal study be r.ed t >r no ut,.-.'r purpose than that of the historian, the case 
histoiy report.,:, or tw gather anecaotU -.ateiial for the purpose of generatinc 
hyivotheses." I' none of tr.,- Sthiie dosi^^ns co.npletely solves the proble:^ 

of conf^Rdin,- ilii.d-.J to^-irl-er and a niniber o"f questions hav6 arisen regarding 
both the analv:.;. r.^h't ihf, .t xl.', 19^6) and the interpretation (Baltes, 
196S) of d..a .-liv-v... '.I,.- n.'d-longitudlnal approach. Thus Uindley 

(IQ77) ....n^r, i.- i r,. n,.,. H. ....tin.', "....it thc .samQ time that he belabors 

the loi..^itudi.'-..il i T r:^r.h.,; o:i dubious assunptiUs, he seems prepared 

- / 
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One example \^ hi> ir;c of projected iongitudinal gradients which, as he admits, 
depend on the assap.ptibn that cnviroaniental inpuU will be approximate^ly oquaj 
over past and future iw- mtrrvai?" ip. 50). It would appear, then, that 
there may be a' bit oi left in lopgLtudina^ research despite the wel'.- 

known, and documented probK^ms it presents in the data collection (Jones, 
195b), data -ana lytic t^^owalsk '-.uir., 1974), and int-erpretive (Cronbach 

Furby, 1970) spheres. 

We approach this question by 5ur.uiiarizing,^the case against the longitudinal 
method in the context of Schaie's trifactor. I developmental model. If we 
write D - f (A,C,i) to rep.-ese.nt Schaie's i.iodel, we sea that there are two 
distinct problems to be ficod. The t^rst If thnt since longitudinal studies 
are indexed fay but tuo -A tne t'lree faetoi(s comprising Scha'ie's model, D = f(A,T), 
we cannot generaUzf the r- .ults of ic:-itudir.al investigation beyond the 
cohort selected for stud/. UtheiviSe stated, if we ar^^ to attempt to generalize 
thd results of a longitudinal stvdy, ■ n'a?t a<^sa"i'> thr-t the cohort effect is 
zero. The secosiJ probIe:ii .ilreadv r^-ent ioned . is that even if the cohort effect 
can reasonabl) be nj;.lbrteJ, ase differences will still be confounded with " 
• time-of-mcasure-:e-it effects, these being viewed, as temporary variations or 
aberrations sup .rinp ^■.--■d the :le: nental function. WTiat Schaie's argument 
cones dour, r,-, th.un, thit iongitudinal studies are appropriate only in 
those cases v.h.-i • ! ■• But nva^t eve'/y study answer all questions? Jt is 
our opinion tint tu aiopt tin>- -^t^it.uie would stifle a good deal of potentially 
valuable re^ei; iii^-re ire r- 1 tuation^ In which the longifdinal approach 

must be e,:iplo> --.t':--- a '. J-ber of question? cannot be answered in any other 

o u- CO. "ci-n i:; with inl i aiiidlvidual patterning 
.... there sinply i' -nh-ti '""■r 

IVnenever we wish to stuay the 
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relationships-between the amount or direction of change for two or more variables, 
or between such change and any other information about' the Individual, the 
only alternative to the longitudi.nal approach is the abandonment of the project. 
Thi^ does not mean that every project is worth doing, that one should flatly ^ 
ignore ppten.ial time-of -measurement disturbances, and that cohort effects are 
mere fignrents of the- imagination. It means simply that w^ should take care 
with the procedural conduct of the s'tudy and prudently limit our inferences to 
the population from which our sample was selected. We need not over-roact to • 
^he point of, jettisoning the longitudinal approach As stated by Jones (1958), 
"If we wish... to achieve a body of developmental theory, we cannot eliminate 
developm.->ntal observation" (p. 98). 

V/hile we certainly do not advocate the use of the longitudinal approach 
in every developir.entai investigation, it is our contention that there are 
situations in which time-of-measurement effects may be safely neglected, e.g., 
in most studies of physical growth, and that when these effects axe unimportant, 
most of the-^bjections to the longitudinal approach disappear. This is primarily 
duo .o the fact that the remaining technical difficulties associated with the 
longitudinal method are counterbalanced by its great efficiency in estimating 
change scores. Kallis and Roberts' (1956) , e.g., estimated that in analyzing 
the weights of men before and after a lapse of time, each of two independent - 
samples would i\ave to contain 2,222 individuals (a total of 4,444 observations) 
to provide th'e same srr.pling reliability as a single paired-sample of 25 men 
measured before and after the Upse of time, l^-hile the data they used to 
obtain these estimates - ^re artificially generated, , they do provide some idea 
of the increase ir. precision of the paired-sample approach which may be 
e.^pectevl i"- practice (se-o also Rao G Kao, 196C) . ' ^ 
^ ' V.(v turn now to 'i --^tion^ dealiru' with the --ucly of ini iNilisdlv l-Iuctl cilangc. 
SoiMt: ,,«thc^.atical mode s uhich can do usou ..u .-.r.. . .h...c c.....^c. pr.st. 
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and discussed in the context of their potent ia' usefulness in developmental 
research. 

'ill. MODhLS F OR' INTRAINDU IDUAL. CUVNGB 
We beg^in, following Kcssen (1960), by agreeing that "a characteristic is 
said to be developmental if it can be related t9 age in an orderly or lawful 
way/* Thus, given a series of measurements x^,x^y...,r^ on a given individual, 
we buppose that the t-th buch measure.ment (t=l , 2, , , . ,T) can be expressed in 
the fopd 

= f(t) + £^ ' (III.l) 

in which the observations x are viewt^^ as being composed of a systematic 

part, f(t), and a random or stochastic part, e /which obeys some probabUitv. 

law. The ba;>ic problem is then to fit a function, f(t) to the observations 

in such a way that tie function (a) provides a close fit to the data, (b) has 
i 

a reasonably simple mathematical r.tructure and (c) has relatively few parameters, 

1th r* definite developmental significance (Israelsohn, 
I960) A number of such functions have been proposed for use in a variety of 
deielOL'ratjntai Circuinstances . ^erhaps the simplest of these is the first-order 
auture^rc>';ivo >rhoiT.8, ov Mn'kov Process, in which 

i(t) = ex^^^ 

( 

so that the value of the observation at time t is a simpl^e linear function of 

i 

thj measurement r.i'Jc !»t the preceding time point. The n(^xt most complex form 
of linear autore.<-;ressive series is the Yule series where 



and .x^ vict--! .iru l i>,- ^ k-j v^lai-^ ui" Liu; observations made at iho pi^ecoding 



two time points. This formulation cr'n be extended in obvious ways and a good 
accourtt au:oresressive model: is proceed by Kendall and Stuart (1968). 
These and a number of other forns for f(t) nay be generated by chara '.erizing 
the developneital process in terms of a differential equation and we here 
sketch some examples of siri.K' differential equations which have been used to 
this end. Lett in j t denote time and x the magnitude of the measurement being 
taken, the different coefficient dx/it then denotes the rate of growth, 
i.e., the increase in x per uriit time. It is generally assumed that the 
growth process mjy be-charactt .ized by a differential equation 



3I = ^t^.^i 

which says that the growth rot-o depends both on time and current size, 
examples to follow, x<e consl-aer ^"ly spccinl cases of the type 



In the 



dt ^ >• ' ' ■> 



(III. 2) 



which may be ..ritten as 



or, solving, 



(III. 3) 

which determl^--s . as a function of t. Turning to some specific e.xamples, if 



we let g(x)-l, >-x and x(X-x) for 0 < x < A in fill. 2), vs>e obtain the differ- 

V 

ential equations 



h(t; 
_ xhftj 
^ ■ (>-.jh(t) 
.x(>-x)h(t) 
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where, in the la^t two equations, a is interpreted as the maximum value of x. 
The four equations relate to quite aifterent and varied types of growth processes. 
Specifically, the respective e4uat.ji^^ .ndicate that at a given time the 
growth rate (I) de^K^ui^ o;i tine, but not on size, (2) is pioportional to siz*^ 
and a function of tin?, (.^) ir proportional to tne ^'growth potential," i.e., 
the maximun si:e ninus current si::e, and a function of time and (4) is pro- 
p'jrtional to both the .turent si:e and growth potential, as well as a function 
o/ time. 

If we now consider the ^'lo ;arithmic differential coefficient" dlog x/dt= 
dx/xdt which denotes the relative growth rate, i.e., the proportional increase 
per unit of ti^e, tlu. last three equations in (III. 4) may be written 



dt 



and 



J log X _ d log(A-x) ^ J 
dt dt 



Solving the-.c a ;:i ilM .1, iho equati-n^ (111.4) yield 

^ H(t) 
log X = H(t) 
l<,g(v = log X - H(t) 
log(^-.>.) - log > = -A H(t) 
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or, if solwd foir x, 

( H(t) 

- { \(l-exp(-H(t)J] 
/■4i-cxin-'H(t))]"' 

» 

Here exp(H(t)) /^^^^ .vherc l- is th? ba^e of the natural logarithms. The 
equations include a constant of integration which may be determined from a 
given value of lx,t}. By looking at particular values of h(t) we can now 
generate a number of e.xamplei, of growth curves satisfying the conditions set 
out following equation (III. 4). Taking h(t) = 6, e.g., we obtain 




For & > 0 the^e ■ incrcM^ing functions of t, the last two having asymptote 
A. Tac last of tr -se eApres^,ioni defines what is gererally called the legist 

. - - ... , r:-..- -r.-r.r t>--3t led to its derivation, we may be 

ablv It. :^jLii: ^:o:lr m^dtcc Lit lOfi f . r the sorts of growth processes it might 
- *.:t ?d to chariiut jriiL*. The equation for growth rate is 



ife., the relative growth rate is a linear function of x. Thus before fitting 
a logistic function to developmental data, one should be sure that the conditions 
implied by these equations do not violate their a priori knowledge of the 

\ • » 

process under consideration. Looked at the other way around, after fitting a 

\ ' " 

logistic ^f unction to developmental data, a reasonable test of goodness-of-f it 

\^ 

would be to'^plot the values of x on the abscissa vs. the values of Alog x / At 
on the ordinate to see whether or not<5a linear relationship obtains. But it 
should be noted that while goodness-of-f it is perhaps a necessary condition 
for the employment of a particular function to mirror a growth process, it is 
by no means sufficient to ensure transcending mere description to the real 
desiderata of explanation. This is due not only to technical, statistical 
difficulties (Kowalski, 1970, 1972), but also to the very philosophy underlying 
the use of goodness-of-f it tests in this context. As stated by Feller C1966) , 
The logistic distribution function. . .may serve as a warning. An un- 
believably huge literature tried to establish a transcendental "law of 
logistic growth": measured in appropriate un.vts, practically all growth 
.processes were supposed to be represented by a function of this form... 
Lengthy tables, complete with chi-squared tests, supported this thesis 
for human populations, bacterial colonies, development of railroads, etc. 
Both height and weight were found to follow the logistic law even though 
it is theoretically clear that these two variables cannot be subject to 
the same distribution. Laboratory experiments on bacteria showed that 
not even systematic disturbances can produce other results. Population 
theory relied on logistic extrapolations (even though they were demon- 
strably unreliable) . The only trouble with the theory is that not only 
the logistic distribution, but also the normal, the Cauchy, and other 
distributions can be fitted to the same material with the same or better 
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goodness of fit. In this competition the logistic distribution plays no 
distinguished role whatever; most contradictory theoretical models can 
be supported by the sane observational material. (p. 52 ) 
Thus the proper emphasis on fitting a turve to longitudinal data is not 
on selecting a function on the basis of goodness-of-fit , but rather on selecting 
a function \vhich accurately mirrors the biological structure of the process 
under consideration. There are certainly enough functions to choose from — 
each with its o\m set of assumptions which must be met if we are to go beyond 
a mere description of our developmental data* In addition to those already 
discussed, we should mention .several others that have been proposed for use in 
relatively well-defined sets of circumstances. In the realm of physical 
growth, because of the adolescent growth spurt typical of the higher primates 
(which may or may not obtain in psychosocial investigations) a parameterization 
consisting of distinct components for prepubertal and adolescent growth is 
often recommended. Thus Deming (1957) suggested the use of 

f (t) = a + gt + Y log(t) 

for the period up to nine years in girls and ten in boys, and from that point 
to maturity, the Gompertz (1825) curve, viz., 

f(t) = a exp [-exp(B-Yt)] 

Similarly, Jenss and Bayley (193*7) fit 

f(t) = a + 6t - exp(Y+6t) 

over the prepubertal period and then used the Gompertz function. An analogous 
strategy was suggested by Count (1945). Examples were 
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provided by Israelsolin (1960). But, as pointed out by Bock et al. (1973), the 
problem as to where ^j^^^urve should end and the other begin is still an open 
question. " They suggested instead the use of a mixture of logistic growth 
curves. In their notation. 



a £-a 
f(t) = ' • 



1 + exp[-b^(t-c^)] 1 + exp[-b2(t-C2)3 
where 

' a^ is the upper limit of the prepubertal component. 

determines the initial slope of the prepubertal component, implicitly 
given by v^ = a^b^/4, the maximum velocity of growth in the prepubertal 
component . 

c^ determines the location in time of the prepubertal component, 
f is mature size. 

= f-a^ is the contribution of the adolescent component to mature size. 

b determines the slope of the adolescent component, implicitly given by 
2 

V = a^b /4,-the maximum velocity of growth of the adolescent component. 

c^ is the age at maximum velocity of the adolescent component. 
In fitting this nodel to data on stature. Bock et al. (1973) were given t, 
observed y, assimed f known and the remaining five parameters (a^, c^ , h^, c^) 
were fit by non-linear least-squares. Another parameterization which permits 
straightforward interpretation of the parameters comprising the model was 
suggested by Weinbach (1941). Here 

f(t) = b^ exp(Cjt) - b^ exp(-C2t) 



ERIC 



91 

99 



where 

is the multiplicative rate of growth per unit time. 

is the size of the individual when he enters the time span of constant 
multiplicative growth in early or middle childhood. 
b2 is birth weight 

and 

c represents how rapidly the child decelerates from birth into the phase 

of constant multiplicative growth. 
The rationale behind the use of this model is that since the growth of most 
physical measurements is decelerative :in infancy and more nearly constant for 
some years thereafter, a convenient mathematical representation of the growth 
of an individual is one which estimates both this deceleration and the more 
constant phase of middle childhood. Presumably the use of another function 
would be required if the age range were extended to include the pubertal 
spurt. 

We might also mention at this stage another model which can actually be 
used to test the hypothesis of a significant change in the pattern of growth 
due to some event E (e.g., puberty) occurring within the interval of observation. 
This is due to Box (1%7) who considered the general problem of testing for a 
'change in the level of a non-stationary time series.- Potential applications 
in the context of the present discussion include checking on whether or not 
behavioral measurements exhibit a growth spurt and in facilitating the choice 
of where different growth curves may be needed to accurately mirror changes in 
rhe processes governing development. Suppose we have a total of T = n + m 
measurements, the first n of these being taken before E, the next m after. If 
then 6 measures the shift in level of the series associated with the event E, 
Bojc's model is of the form 



erIc . ■ -f^'O 



t-1 

L + Y I a . + a for t<n 



■ t-1 
L + 5+ Y ^ ct 

0 



for- t>ri 



where L denotes the initial location of the series, is a constant, 0 £7 < 2, 

0 o 
* ' • " 2 

presumed kno\^n, and the a's are independent normal deviates having variance a . 

It may aid in the interpretation of this nodel to write 



t-1 



t-2 



which emphasizes its autoregressive structure. Box then shows how to estimate 
0^, L and 5 (say by s^, L and 6 ) from the data and the required test follows 
from the fact that 



tl - Cl-Y [1 - Cl-Y,)""] 
C6-6) { 2t- ~T 



(III. 6) 



has Student's t-distribution with' n + m - 2 degrees of freedom. Box approached 
this problem from the Bayesian point of view in which certain (non-informative) 
prior'distributions for the parameters in the model were assumed, (III. 6) then 
representing the posterior distribution of 6. The test can, however, be 
directly applied in the more usual Neyman-Pearson framework where no a priori 
information concerning these parameters is invoked. In either case, is 
taken as known but Box has sho\m that (III. 6) is relatively insensitive to 

changes in the value of y • 

The point of the above examples is to acquaint the reader with a number 
of models which have been proposed for representing intraindividual physical 
growth. As already noted, it is important to realize that in the competition 
between these models, goodness-of-fit plays a relatively minor role. IVhile a 
poor fit of the model to the data should reasonably cause one to question the 
applicability of tho model under consideration in the context of the current 
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problem, a good fit to the data is not sufficient to insure this applicability* 
A more prudent course is perhaps via the derivation of a model that satisfies 
certain definite a priori requirements imposed by the structure of the develop- 
mental process under consideration. This may be approached by the use of 
differential equations as sketched above (see also Shock, 1951). Alternatively, 
the properties of available models can be checked to see whether or not they 
conform to these a priori criteria. Thus, for example, if we wish to use a 
model that is consistent with allometric growth, the use of the Gompertz curve 
may be appropriate (Deakin, 1970) . 

On the other hand, if only a simple descriptive function is required 
and/or little is known about the mechanisms governing the growth process, tlie 
class of polynomial functions 

f(t) = + a^t + a^t^ +...+ a^t^ 

are apt to be satisfactory and have the convenient property that the "mean 
curve" (that fitted po the observed growth patterns of a number of individuals) 
is equivalent to the "mean constant curve" (that obtained by fitting the in- 
dividual records to a set of such polynomials and then averaging the coef- 

ficents a. ). This- is not true for growth curves in general (e.g., Gompertz, 
1 

logistic) and thus the character of the individual curves are subject to dis- 
tortion through group averaging. This may be a critical point in practice 
since indiscriminate averaging tends to over-smooth the growth curves, masking 
the inherent interindividual variability, which is often of prime importance 
ia the study of growth. Thus while polynomial growth curves may not lend 
themselves to easily interpretable explanatory models for growth processes, 
they may still be useful for the description of development and in the effective 
reduction of the observations to a small number of parameters characterizing 
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the observed course of growth. This method was introduced by Wishart (1938, 
1939) who suggested that the growth curve for each subject be broken down into 
its mean and linear, quadratic, etc. components, each of these being subjected 
to separate analysis. The effects of treatments on the average growth rate 
could then be seen from the analysis of the linear components, and analysis of 
the higher-order components would show to what extent the treatments were 
effecting the shapes of the growth fcurves. The method was valuable in that it 
succeeded in replacing the successive observations on growth by a few summary 
figures which led to efficient comparisons between the groups being studied 
(Rao, 1958). 

In an. attempt to extend this approach, Rao (1958) considered the problem 
of transforming time by a function = G(t) in such a way that the growth rate 
is uniform with respect to this new time metameter, so that an adequate 
representation of growth would be available in terms of the initial value of- 
the measurement and the redefined uniform rate. This method produces the- 
required transformation from the data in hand, provides a valid test of the 
hypothesis that the average growth curve is the same under all treatment 
conditions irrespective of any assumptions on the nature of the growth curve, 
and it i^ not even necessary to know the exact values of the time points at 
which the observations were made. Rao (1958) also considered the model 

where y is the increase in the t-th interval, i is a parameter specific to 
ta ^ 

individual a, g(t) is an unknown function of tim^ only, and is a random 
error. IVlv-^reas the first method did not depend on any assumptions about the 
individual .growth curves, (III. 7) implies that, apart from a deterministic 
linear trend for growth with respect to some time metameter, there. are independ- 
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ent disturbances taking place in small intervals of time. By a common trans- 
formation T = gCt), all the individual growth curves can be made linear apart 
from random fluctuations. 

Finally, Rao also considered extending fill. 7) to its factor-analytic 

analog 

where X^^\ X^^^ correspond to the factors and g^, g2 to the regression 

coefficients. If (111.8) holds, we should be able to replace the growth curve 
by its estimated factor values X^^\'x^^\... and to single out the 
dominant ones for further analysis, i^ile this approach has obvious merit as 
a potentially "valuable data- reduction technique, (III. 8) differs enough from the 
standard factor analysis model to require an entirely new set of associated 
significance tests and these have not as yet been worked out. In case can 
be assumed independent of t. Hotel ling's principal component analysis may be 
used to obtain the requisite factors and standard tests can be applied (Rao, 
1958) . 

In the following sectijons we consider how some of these models for intra- 
individual development are used in the study of interindividual differences in 
developmental patterns and in providing tests of hypothesis concerning the 
mean .patterns of growth in several groups of individuals. 

IV. MODELS FOR INTERINDIVIDUAL CHANGE 
■ men an investigator is concerned with a single attribute measured longi- 
tudinally on one or more groups of " individuals, there are a variety of analytical 
models which can be employed. These techniques which are quite different from 
. those described above for intraindividual analysis, fall into three main 

categories: (1) univariate analysis of variance, (2) multivariate analysis of 
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variance, and (3) polynomial growth curve (PGC) models. For any particular 
analysis problem,, the choice of one of these three approaches should be made 
as a function of the extent to which the structure of the model is appropriate 
and the extent to which the statistical assumptions are met. In describing 
these three approaches, careful attention will be paid to these points. 
However, most attention will be given to the PGC models which afe least widely 
considered in applications. 

The univariate analysis of variance models are probably the most widely 
used, most widely documented (viz. Winer, 1962; Gaito 5 Wiley, 1963), and most 
problematic approach to the analysis of longitudinal data. In the case of a 
single sample of individuals, the approach is often referred to as trend 
analys-is (Winer, 1962; Kovalski § Guire, 1974). In this model the total sum 
of squares is partitioned into components attributable to individual differences 
time, and error under the assumption of no interaction between the time and 
individual factors. This model allows the investigator to test the overall 
hypothesis of no differences attributable to the time factor. It is also 
possible to subdivide the sum q£ squares for time into orthogonal polynomial 
components allowing hypotheses concerning the shape of the time response to be 
tested. 

In the case of two or mors samples of individuals measured longitudinally, 
a repeated measures analysis of variance (Winer, _1962) can be employed. In 
this model, individuals are treated as a random factor nested within groups 
with repeated measurements over time. In the context of this model the main 
null hypotheses of interest are (1) no time effect, (2) no group effect, and 
(3) no time by group interaction. The last of these hypotheses is often of 
greatest interest since, it can be thought of as a test that the time response 
functions of the k groups are parallel. As in the simpler case described 
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above, it is possible to partition the time effect into orthogonal polynomial 
components to gain greater insight into the shape of the time response. Tliis 
k- sample repeated measure design can be thouglit of as a prototype for a great 
variety of more complex models in which the k- groups are structured as the 
levels of a factorial or other design. It is also possible to structure the 
repeated measure as levels of a more complex experiment. 

These analysis of variance models seem at first glance to be ideal for 
the analysis of longitudinal data since they are relatively simple and the 
questions of interest correspond to hypotheses which can be tested in the 
context of these models. The problem, of course, iias to do with the validity 
of the underlying statistical assumptions of the models. It io an unfortunate 
fact that the ratios of mean squares will have an exact F-distribution only 
under rather restrictive assumptions described by Huynh and Feldt (1970). A 
sufficient condition for the result requires that the repeated measures are 
normally distributed, ha\re equal variances, and either are mutually independent 
^wJ^^ or have equal correlations (Greenhouse § Geisser, 1959). The assumption of 
mutual independence is virtually never tenable and the assumption of equal 
correlations is seldom tenable when the repeated measures are indexed by time 
since adjacent pairs of measures will almost always be more correlated than pairs 
separated by a greater time interval; If the investigator does not wish to 
prejudge the validity of the equal correlation assumption, a test of equal 
correlation is available (Box, 1950). \Vhen the assumption of equal correlations 
clearly does not hold. Box suggested that it might hold if the analysis were 
performed on differences between adjacent measurements rather than on the 
original data. The only other approach to salvage the univariate analysis of 
variance models for the analysis of longitudinal data when the equal correlation 
hypothesis is not tenable is an approximate procedure proposed by Greenhouse and 
Geisser (1959). They have shown that the ratios of mean squares have approximate 

O 



\ 



EmC " 106 



F-distributions with modified degrees of freedom which are a function ot the 
unknown population variance- covariance matrix. They further show that there 
is a lower bound on the degrees of freedom which is independent of the unknown 
parameters. Unfortunately, the use of this lower bound gives a test which is 
conservative in the sense that the null hypothesir will too often be accepted 
when it is not true. This loss of power may well be unacceptable* 

Because of the restrictive assumptions of equal variances and covariances, 
it is clear that univariate analysis of variance approaches are not applicable 
in most situations and that other models which are not dependent on this 
assumption are needed. Multivariate analysis of variance techniques provide 
such a class of models. In the case of a single sample of individuals measured 
longitudinally, the multivariate analog of trend analysis can be thought of as 
a multivariate generalization of a paired t-test. In this situation, the data 

consist of the vectors x'. = (x.,, x.^> x, ) for i=l, ,N and the hypothesis 

of interest is that of no time effect, i.e., 

H : 11 = jii 

o Z, 

where u is the mean vector, ]i is a scalar, and j' = (1, JL, J). Morrison 

(J972) has shown that under the assumption th^t the observations are an inde- 
pendent sample from a multivariate normal distribution, the maximum likelihood 
test of this hypothesis is equal to a test of the hypothesis 

H : Cji = 0 
o ^ 

where C is any (p-1) by p matrix with the property Cj = 0. In practice, C 
is chosen so that the transformed observations are the successi\re differences 
of the original data. 

This model also allows the investigator to obtain simultaneous confidence 
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intervals for all contrasts a'p of the repeated treatment medns using Scheffl's 
method of-multiple comparisons, '..-hen the null Jiypothesis is rejected, this 
capability allows more precise statements to be made about the nature of the 
time response. In particular, the contrasts a could be chosen to be orthogonal ^ 
polynomial contrasts. In addition to this basic result, Morrison (1972) 
derives analogous test statistics and confidence intervals under the more 
restrictive assumptions of (1) equal variances and covariances and (2) reducible 
form for the variance-covariance niatrix. He then compares the lengths of the 
confidence intervals with those derived with no structural assumptions. It 
seems clear that these methods provide a reasonable alternative to trend 
analysis under a variety of conditions which an investigator might be willing 
to assume. 

The multivariate analysis of variance approach to the k-sample problem of 
repeated measures is kno.m in the literature as profile analysis (Greenhouse 5 
Geisser, 1959; Morrison, 1967). The basic model is that of a k-sample multi- 
variate analysis of variance in which the observation on the jth individual in, 

the ith group is denoted.y',. = iv.^y y,^2' ^'i.P^ ^"'^ '° 

nave a multivariate normal distribution with mean y. and variance covariance 
matrix I. The linear model for these observations is 

E (Y) = X B 
(nxp) Iny-k) (kxp) 

where X is the k-samplo design matrix and B is the matrix of group means. In 
the context of this model, it is possible to test hypotheses of the form C B A = £ 
for arbitrary C, A. and V satisfying the requirements of the general Gauss- 
Markoff theorem. In particular there exist choices of C, A, and T to test 
the three basic null hypotheses of interest. 

The first of these null hypotheses H^y is that the k profiles are 
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* parallel which is analogous to the test of no group by time interaction in 
the^uixiVariate analysis of variance approach For appropriate choice of 
C, A and F, this hypothesis has the form 



^'11 - ^12 
^2 - ^23 
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which is equivalent to a one way multivariate analysis of variance on the 
difference's between measures made at adjacent times. 

The second nulls hypothesis 11^2 is that there, is no change' through time, 
that is, 
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Matrices C,- A and r can be found to test the hypothesis in this form which 
assumes nothing about the parallelism of the profiles.: However, Worrison 
(1967) proposes' an alternative choice of the test matrix which causes tKa«=i-r~. 
hj-pothesis rested to be based on equality of sums oyer groups for each variable. 



The vest in this form, is ' 



jp 



which is interpretable only under the assumption of paralHel profiles.- 

The third hy^ot-htTsis', H^^ , is that there ajre no group differences. 
Without thfe assumption -of parallel profiles, this hypothesis has the form: 
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As above, under the assumption of parallel profiles, Morrison (1967) suggests 
alternative hypothesis based on the sums over measurements which has the 



an 
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As in the case of univariate analysis of variance, the basic k-sample MANOVA 
model can, be generalized to more complex designs by considering the k-samples 
as levels of a factorial or other experiment or by assuming some structure for . 
the repeated measures. McCall and Applebaum (1973) present" such a generalization 
with six repeated measures structured as a two by three factorial design. 
.They then compare the univariate and multivariate results for this case and 
conclude that the multivariate approach is superior. 

In the profile analysis model, it is important 'to point out that the only 
assumMons made are that the longitudinal series for each individual has a 
multivariate normal distribution with the same variance covariance matrix in 

■ each of the k groups. The assumption of parallel time response functions in 

■ the k groups is not necessary. It should additionally be pointed out that the 
model does/not assume anything about the structure of repeated measures. It 
is in fact not necessary that they be indexed by time cf measurement, be 
equally spaced, or even ordered. Because of this lack of structure the model 
simply tests whether the tine response functions have the same shape without 
providing a model which describes the shape of the function. 

The^nal ma^jor class of models which we will consider are th? pol>-nomial 
growth curve (PGC) models. This class of procedures differs from those 
already considered because the models are formulated as a function of the 
structure of the repeated measures. In the previous cases, this structure 
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could be incorporated by considering appropriate contrasts but was not in- 
cluded in the overall tests of hypotheses. 

The development of the PGC approaches goes back to the pioneering work of 
Wishart (1938) which was alluded to earlier as a way of summarizing an in- 
dividual's time response with a few lower order orthogonal polynomial regres- 
sion coefficients. Rao (1958) improved on this basic idea by suggesting that 
the time scale be transformed so that more complex ti-me response functions . ' 
could be adequately summarized by the linear coefficient computed with respect 
to the modified time axis. More recent developments in the area of estimating 
and testing hypotheses about the average PGC of one or more groups have been 
provided by Rao (1959, 1965, 1966), Potthoff and Roy (1964), Khatri (1966) and 
Grizzle and Allen (1969). These investigators have provided a variety of 
procedures which are equivalent under certain but not all conditions. Because 
of the extent of overlap between approaches, we will concentrate primarily on 
the Potthoff and Roy approach s^ce their. basic model seems most appealing. 
However, we will point out relationships between their results and the work of 
Khatri and Rao. 

As presented above, the usual MAXOVA model can be written as 

E (Y) = X B 
(n'<p) (n'<m) (mxp) 

where the rows of Y arc assumed to be independent and follow a multivariate 

normal distribution with variance covariance matrix £, X is a design matrix 

of kno^m constants, and B is a matrix of unknown parameters. In the context 

of this model, it is possible to test hypotheses of the form 

H : C B A = r 
o - - - 

(qxm) (ni'<p) (pxu) (q'^u) 

' for appropriate choices of C, A and F satisfying the generalized Gauss- 
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Markoff theorem (Timm, 1975). It is also possible to provide simultaneous 
confidence intervals for functions of the form 

b» C B A ' f 
(Ixq) (qxm) (mxp) (pxu) Cuxl> 

for all b and f» 

Potthoff and Roy (1964) propose a more general model of the form 

B (Y ) = X B Q ^ 
(nxq) (nxm) (m^p) Cp><q) 



where has rows which are indepe]|^ent and follow a multivariate normal 
dis^tribution with variance-covariance matrix , X is the ^between individual 
design matrix of known constants, B is a matrix of unknown parameters, and Q 
is the ^within individual' design matrix. Potthoff and Roy show that this 
model can be reduced to the previous M-\NOVA model with the same paiameter 
matrix B by considering the transformed variable 

Y = Y G"-'- Q' CQ G Q')""^ 
^o - - ^ - 

where G is an arbitrary q by q symmetric positive definite matrix. In their 
original discussion, Potthoff and Roy suggested that the choice 2 ~ ?o 
be optimum but that since was unknowTi and the distribution theory of 
using a data derived estimate of was unknown, another choice which approx- 
imated I but which was not data based would, be appropriate. The choice of 
^o 

taking G = 1^ was also discussed. Subsequeat results by Khatri (1966), Rao 

(1965), and Lee (1974) established the usefulness of choosing G = where 

/\ ' > > 

Z is the data based estimate of Z^. 
o o 

Given this basic model, the, one sample problem considered previously can 
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be parameterized by choosing 



X 



and Q = 



1 

p-1 



1 

t. 



... 1 



2 q 



so that the expected value of the jth observation on the ith subject has the 
form 

2 



for all i and j . It is important to point out that the form of the time 
response is assumed to be the same for each subject i.e., have the same 
degree. For appropriate choices of matrices C and A,_this model allows an 
investigator to tQst hypotheses about the regression coefficients. In particular, 
one could test the adequacy of a model of a certain degree; or using the », 
result for simultaneous confidence intervals, confidence bounds for the mean 
growth curve could be derived- 

The^ generalization of this model to the case of k, groups of individuals 
with N. individuals/ in the ith .group is straightforward. The matrix X(N,k) is 

constructed to contain N^. rows of (1,0;..., 0), N2 rows of (0, 1,0, . . . ,0) , , 

and N, rov> of (0,0,... 1). The matrix Q is chosen as above. With this 
specification, _the expected value of the jth observation on the ith subject in 

I 

the* kth group, has the form ^ 

kl 



^f>^kij) = ^ki^^k2^j^^k3^'^--^ vr 



With this model, .matrices C a.iJ A could be chosen to test the complete, equality 
of the k regressions, the parallelism of the regressions, or the adequacy of a 
model of some lower degree. As in the case of the other methodologies discussed, 
generalizations of the k-sample model to more complex situations are possible. 
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Tinun (1975) presents an example in which the k groups correspond to levels of 
a two factor factorial experiment. 

Alternatives to the use of the Potthoff-Roy model include the one sample 
PGC model proposed by Rao (1959) and the independent but essentially complemen- 
tary developments by Khatri (1966) and Rao (1965, 1966, 1967) which are argued 
to be superior since they eliminate the arbitrary choice of the matrix G. 
■ These models have the form 
« E(Y)=XB + Zr 



where Y, X, and B are as before, Z(N,p-q) is a matrix of covariates chosen from . 
the higher order orthogonal polynomial coefficients, and T is a matrix of 
unknown covariate coefficients. If the covariates are not included, the , 
results are identical to the- choice G = I in the Potthoff-Roy formulation. If 
all of the q-p covariates a;re used, the Rao model is equivalent to the model- , 
proposed in Rao (1959) and. to the choice G ,= S in the Potthoff-Roy model where 
S is the data estimate of Z^. Rao .(1966) and Grizzle and Allen (1969) 
recommend the .use of some but not all of the p-q possible covariates with the 
decision of which covariates to include determined by the data. The important 
point of this rather technical discussion' is that the various choices are more 
similar than different and that each formulation has its^ problems, i.e., the 
choice of G for Potthoff and Roy and the choice of which covariates for Rao. 
In any case the class of models is rich and seems to answer" most questions of 
interest. 

.The preceeding sections discussed a variety of methods fior interindividual 
' analysis which (1) were der.ived under an assumption that the data' we^re sampled 
' ' from a univariate or multivariate normal distribution (2) made inferences in 

classical statistical, fashion on the basis, of the sampling distribution of 
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statistics (5) made a tacit assuiaption that all data were present in all of 
the longitudinal series studied, and (4) considered only a single attribute 
measured longitudinally. It is the purpose of this section to discuss briefly 
approaches in the literature' fot which not all of these four conditions 
pertain. 

The assumption of univariate normality usually does not present a problem 
in most data analyses since the validity of assuming normality or the extent 
of deviation from nora)lity can l)e assessed easily either by using a testing , 
.procedure or by insr/cting histograms or probability plots. In contrast, the 
assumption of mul^variate normality raises more serious problems since testing 
and graphic procedu^s are not nearly as available and results concerning the 
robustness of procedures in the absence of normality are largely unknown 
(Kowalski, 1972). In order to avoid the assumption of normality, nonparamet^ic 
approaches have been developed for many data contexts, but these approaches 
have been conspicuously absent from the longitudinal data analysis literature. 
One exception is the paper by Ghosh, Grizzle, and Sen (1973). In this paper, 
two examples are considered in which the longitudinal series for each individual 
are replaced by a vector of regression coefficients which summarize the 
individual's, time response function. Under the assumption that these coeffi- 
cients have a continuous but not necessarily multivariate normal distribution, 
statistics based on ranks of the coefficients are proposed, and inferences are 
based on the permutation distributions of theie statistics which are asymp- 
totically x'- The main hypothesis tested is equality of treatment groups in 
a design that includes k .block factor. Wnile the precise results on the 
asymptotic^relative efficiency of these procedures are not known, the authors 
assert that these approaches have high asymptotic relative efficiencies for 
distributions with heavy tails and that the procedures are robust in'the 
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presence of gross errors cr outliers. 

■ The second common attribute of the interindividual procedures discussed 
in the previous sections is the fact that they are all based on sampling 
distributions of statistics. This fact is not in any sense an assumption of 
the models analogous to the assumption of normality but rather a constraint on 
the type of inferential statements that can be made. The major alternative 
inferential context is the Bayesian approach which, among other differences, 
allows prior information about" parameters to be formally incorporated in the 
analysis. Unfortunately, there are few examples of the application of Bayesian. 
inferential methods to longitudinal data analysis problems. One such application 
is the work of Geisser (1965) and Geisser and Kappenman (1971). In these 
papers, the profile analysis model is considered' from a Bayesian point of view 
for, respectively, the two and k-group cases. Under the assumption of parallel- 
profiles, a posterior region is derived for the difference between profiles 
,in the case of two groups and for the vector of differences between the,k-l 
pairs of adjacent profiles in the case of k-groups. This derivation is consid- 
ered for both "non-informative" and "natural conjugate" priors. 

The third point concerns the presumption of complete longitudinal series. 
This requirement is, in practice, quite severe since it is often the case in 
protracted studies that only a small percentage of the series are complete for 
all ages. The loss of data imposed by this constraint is even more serious 
inferentially if there is any reason to believe that the occurrence of missing 
data is in any way related to the value of the attribute being measured. This 
problem can be dealt with in at least a couple of ways. One method would be 
to take the approach used by Wishart (1938) to replace the longitudinal series 
by sununary parameters which can be estimated even in the presence of a moderate 
amount of missing data. Such derived data, though not precisely idehtically . 
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distributed, should allow at least an approximate analysis using a larger 
sample size. 

A more formal approach to this problem was suggested in a recent paper by- 

Kleinbaum (1973) who' generalized the polynomial growth curve formulation of 

Potthoff and Roy to consider the presence of missing data. In the presence of 

complete data the model has the form 

E (Y) = X B Q 
(Nxq) (N'xm) (mxp) (pxq) 

If|the structure of the data is such that there are ^ blocks of cases with 
Nj, cases in block I and that within block I all cases are complete for some 
number o of the q observations, Kleinbaum proposes a modified model 



(N^xq^) ■ (Nj^xm) (mxp) (pxq) (qxq^) 



where H is an incidence matrix of zeros and ones. With this model it is 
possible to obtain best asympototically normal estimates 'for^inear functidhs ^ 
-*of the parameters and to test hypotheses about such line-r functions. 

IvTiile this approach may be useful in correcting for data missing by 
chance, it is also applicable to situations in which data are missing by 
design as in the case of mixed longitudinal cross -sectional designs (Prahl- 
AnderS^ri*^ Kcfwalski, 1973). ^ 

The fourth point concerns the fact that all of the preceeding discussix)n 
at both the intra- and inter- individual levels has been restricted to situations 
^ which are univariate the sense that the data have consisted of a series of 
measurements of a single attribute indexed by time. The extension of these 
approaches to the case of a three dimensional data matrix in which two or more 
variables "re measured Ibngitudinally introduces a new level of complexity. 
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Several approaches to this problem have been suggested in the literature for 
both intra- and inter-individual analysers (Kowalski 5 Guire, 1974). Of these, 
the approach most widely used in biological applications is bivariate allometry 
which relates the growth of exactly two dimensions in a single sample of 
cases. Attempts to extend this approach to more than two dimensions have been 
made but not without introducing additional problems of interpretation. 
Another avenue of approach to this problem has been in the area of factor 
analysis generalized to the case of a three dimensional data matrix. Such 
approaches, which go beyond the scope of this presentation, seem also to 
introduce difficult problems of interpretation. 

Of the topics discussed in this paper for the univariate case, two areas 
seem to offer a way of approaching the problem of a three dimensional data 
matrix. The first approach is sinply to reduce the problem to a two dimensional 
one by summarizing the longitudinal series for each variable with one or more 
deriVed variables. The methods of section III for intra-individual analysis 
provide a variety of possible ways in which this could be done* Possible 
candidates for such summary variables include orthogonal polynomial coeffici.ats 
(Wishart, 1938; Rao, 1958), the parameters of an appropriate Gompertz or 
logistic model (Bock et al., 1973), or the scores derived from a principal 
components analysis of the longitudinal series as suggested by Rao (1958) . 
Such summary parameters could then be used in a variety of multivariate analyses 
which either analyze the structure of a single sample or compare two or more 
samples. The utility of this approach obviously depends on the^ choice of 
summary variables, which introduces a certain degree of subjectivity into the 
analysis. However, it would seem that this approach makes considerable data 
analytic sense. 
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The sdcond approach is provided by the.Potthoff and Roy polynomial 
growth curve models which can be applied directly to the case o£ two or more 
variables measured concurrently. Tliis can be done simply by appropriate 
choice of the pije- and post-design matrices. One could, for example, specify 
a model in which a polynomial was fit separately for two or more variables 
taking into account not only the correlations within a series but the cor- 
relations between series as well. Having fit such a model, one could test 
whether the several time response functions were equal or parallel. More 
complex nodels involved more than a single sample could also be considered. 

. SUMMARY 

■We have attempted to survey a variety of methods which are appropriate 
. for the analysis of a single longitudinal series and for the analysis of one 
or more samples of longitudinal observations. We also attempted to place in 
perspective the role of such methodologies in the broader context of 
developmental research. Having done this, it seems appropriate to coininent 
on the current state of the art from the point of view of both theory and 
practice. 

In 1963 Bereiter, observed that defMiencies of statistical methodology 
seriously impaired the scientists investigation of .questions dealing with 

, change. Since that observation was made, a great deal of theoretical work 
has been carried out. At the intra-individual level, new models have been 
'proEosed by Bock (1973) and others which are parameterized in ways that 
facilitate biological interpretation of the fitted curve. At the inter- 
individual level, the development of polynomial growth curve models which 
began with the .>^ork of Rao (1959) and Potthoff and Roy (1964) is certainly 
the most notable advance of the last few years. Because pf these 

• achievements and others one would have to conclude that the state of the 
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art has\ indeed improved in recent years. One would also have to conclude 

\ ■ ... 

that th^re are many interesting and challenging problems remaining.^ At the 

theoretical level, the problems of growth prediction for individual series, 

of multi-lrariate data observed longitudinally, and of nonparametric 

alternatives to normal theory procedures stand out as areas of ongoing 

interest/' At the applied level, the challenge bf testing new methodologies 

in a variety of contexts always exists as statistical practice lags 

frustWcingly far behind statistical theory. 
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ABSTRACT 



An experimental design notational system is described, A '*minir:al power" 
check is recommended for use with complex analyses of covariance structures. 
Longitudinal models always include Repeated measures. Conventional .\NOVA 
longitudinal analyses are contrasted with covariance type linear models • , The 
-covariance models have the virtue of permitting the use of P different organ- 
ismic (X) variables, while conventional ANOVA usually is limited to one. Tests 
of homogeneity of regression slopes are illustrated for covariance typ^ DoJels 
with a repeated measure factor and: (a) X's available on subjects but not each 
separate occasion; or (-b) X's available for each occasion. 




ERIC 



115 



123 



I. INTRODUCTION 

JLongitudinal studies automatically imply that there will be one or more 
repeated measure factors (Kirk, 1968; Winer, 1971). For convenience we shall 
label one repeated measure factor as T, the time factor. The simplest possible 
design is to obtain several subjects drawn at random from some meaningful 
population, and record the dependent variable, Y, upon those subjects over the 
T factor. ^This permits the plotting of individual "growth" or T curves on Y. 
Unfortunately, when we note that the curves for John Smith and for Tom Johnson 
-are different, we have gained little useful knowledge. Since these individuals 

e 

differ in many ways% we have no basis for distinguishing future individuals who 
are likely to show the "Smith curve" instead of the "Johnson curve". To obtain 

# 

useful information it is necessary to have available data on other trait or 
organismic variables that may be used to classify or group the individual 
subjects. We shall label these variables as X's. X may be something aseasily 
observed as sex, or something that must be measured by instrumentation or 
psychological tests. Thus we may have a study in which children are grouped 
into those with internal locus of control versus those with external . locus of 
control. If tHese groups now show divergent T curves on Y, we have obtained 
useful information such that other children may be assessed on this X and 
predictions made about the type of T curve expected. ■ Thus the -minimum useful 
design is one where there is at least one X in addition to the dependent varia- 
ble Y. 

I^. REPRESENTATION OF EXPERIMENTAL DESIGNS 
It is helpful to have a concise notation to express the information 
, available in a given design. Ke need two basic terms. Tivo factors are crossed 
if each level of each factor appears with each level of the other factor. Since 
each subject, S, appears with each level of T, we say S and T are crossed 
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and represent this as S x T. We may use subscripts on the factors to represent 
the number of levels. Thus x indicates that n subjects are crossed with 

5 levels of time. . " , 

If a level of factor .\ occurs within only one level of factor B, then we 
say A is nested in B. This is represented as A in (B) . In a completely random- 
ized one factor design where 50 subjects are randomly divided into 10 subjects- 
under each of 5 levels of factor A, we would write S^^ in (A^V A completely . 
\ randomized factoral design with 2 levels of A, and 3 of B may be represented as 
■ S "ii (A X B.). Since subjects are nested in the AB crossing, this shows that 
any one Lbjelt appears in only one of the 6 cells formed\y 'the AB crossing. ■ 
Lee (1975) has written an ANOVA text using crossing and nesting notations 
' throughout that should, be consulted if an expansion of this brief explanation 
is desired., 

. we must also add a notation to express the role of X. We shall use X to 
stand for any continuous variable available other than the dependent variable, 
" y! We shall arrange the terms so that when X is present, it implies an X in 
- every unit prior to the appearance of X. Thus w X x T^ implies that there 
is an X available with every subject, or' here a total of n values of X. However, 
if there is an X available on each .observation, this would be represented by 
• placing the "w X" last, -^us x T, w X implies there are 24 values of X 
available, or an X associated with each of the 24 observations of Y. The w is 
for nmemonic value since the S w X x T would be read as .Subjects, with an X 
value on each, crossed with T. ■ . • 

These' symbols may be combined to represent more complex designs. As an 
example 'with one repeated measure, B, and one between sub:) ects' measure. A, 
Winer has an [S. in (A,)] x B^ design (1.7^, p. 525).^ TT^e [ ] bracUets^^ndicate 
B is crossed with both A and subjects, '.e must -distinguish whether there is ' . 
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only one X for each subject, or one X for each observation. An example of the 
former is an [S^ w X in (^.2)] x in Winer (1971, p. 803) while an example of/ 
the latter is an [83 in (Aj)] x B2 w X (Winer, 1971, p. 806). 

Naturally it is possible to have more than o^e organismic variable in a 
study. To indicate more tnan one, we will add extra values o,f 'X. We shall 
designate the number of X variables as P, and may represent a more general case 
of Winer's covariance example (1971, p. 803) as [S w X^....Xp in (A2)]- x 62- 

III. POSSIBLE ROLES OF ORGANISMIC VARIABLES 

A. Reduction of Error Te^ 

There'are several -possible roles of organismic variables in. longitudinal - 
designs. In some designs they may be included' primarily as a device to- reduce 
the error term, and increase the poWer and precision of the comparisons made. ^ 
If we have variable X, we may divide it into 4 adjacent intervals, and^treat 
"these four levels as a factor with subjects nested in the four levels. If the 
. initial design involves' a manipulative factor A, the design may be expanded by 
adding the additional 0 factor with four lev4js: Thus. an initial. [S^^ in ' • 
(A3)] X T2 'design may be expanded to an [S^^ in'(A3 x 0^ )] x T-2 design. In 
" the litter design the additioA of the 0 factor should reduce the error term for 
the A effect, m^^^^y just as in a treatment by levels design.^The statistical 
considerations of such usage are well -covered in Lind^uist (1953, chapter 5) 
and Myers (1972, chapters). . • 

^An altemativb way of using an organismic va'riable to reduce mean square 
error (MS ) is to use X as a covariate in a legitimate e^g^erimental design. 
' Witli an [S w X in "(A)) x T design where subjects wer^^ randomly assigned to the 
A cdnditipns so the X values vary only by chance, the major role of a covariate 
would be in reducing MS^^^^ term, the"' error 'term, for the A main effect. A test 
for heterogeneous slopes in such a design is illustrated later in^the present 

chapter. , • .• 
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B. Identifying Variable by Time Interactions 

A second role of orgaoj-smic variables is in a search for organismic 

variable by time interactions, or a search for organismic variable^by treatment 
./interactions that tfccur over time. In an (S in (A x 0)] x 'T design, the AO 

interaction would be an exalple af an "aptitude by treatment" interaction. 

Jhe presence of an OT int^eraction would indicate different grow^hscui^ves. for 

the several 0 levels. A significant AOT interaction would indicate that the 
• o^ptitude by treatm.ent interaction changed over time. , . * 

* . Similar searches for/0 interactions are possible without subdividing X 

"into levels and using it a* an additional factor in an analysis of variance. 

■ In ah [S w X in (A)] X T design'^he check of homogeneous" regression slopes is 

" -fetiuiv^ient to a test fpr a linear AO int'eraction/Ttius the finding 'of 'heterogen- 
eous slopes in'a covariance- model is another way of discovering an "aptitude by. 
treatment" interaction/ , ' , 

" Similarly, if there is interest in a possible X by T i^^teraction, it is 
possible.to build'vectors- c6nsia|ing of the X vector multiplied by contrasts, of 
. the T factor to determi-ne df there is an XT interaction. Unfortunately, this 
, . involves metljodol'^y that ikless ^kely to be'u'sed. Similarly, the search for. 
i triple interactr^ b/ use'of AXT vectors is even less common: The beginning 
' studaJit"is probably weir' 'advised to usd Ihe blocking method of ^forming an (5 
- variable, and AOV wherv he has only' a single X variable. The complexity of the • 
other methods is Wly needed when there 'are several X variables. 

■ C- Clarifying the Nature of Relationships . * ' 

the third role of organismic variables is in an attempt to "eliminate" the 
effect of other "extraneous" organismic variables to provide "clear" interpretat- 
ions. ' This is the role of partial correlations, part correlations, and sometimes 
of analysis of covariance when the X's differ systematically due-to the fact 
that a legitimate randomization of experimental subjects has not been carried 
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out. Unfortunately, 5uch usage is easy to misinterpret. Campbell and Erlebacher 
(1970) give a long, detailed presentation of such problems. 

Some such studies take a multiple regression form. We may ask, for example, . 
how muchefSect does education have on income at age 40 after iq, SES, and 
parental income hkve been "partialed out." Such^ a study computes the residual 
increment in ^^254 " 4.123 "^^^^^ education is the fourth variable of the ^ 
four highly i-ntercorrelated variables. The problem is, each of the four variables 
may have a very low "additional contribution" so that no matter which of the 
variables is placed last, it will contribute very little once the other variables 
have entered. Thus ^ ^uZ'i^ - R?.i24 ^^"^^^^ low' suggesting that parental 

, income is a very minor contribution once education, SES, and IQ have been 
partialed out.. Unfortunately, some authors (e.g., Bowes § Gintus, .1972) 
report only the one type of partialling that fits the investigators' intellect- 
ual framework. The statistically naive reader is left with the impression that 
this has .been a dramatic demonstration that education has no effect on future 
income. Such a s-.udy merely reveals high intercorrelations between the predict- 
ors so that no one predictor makes much of a unique contribution once the 

Others have been used. 

•••Unfortunately, there is no solution to obtaining clear 'causative conclusions 
in the absence of manipulative stiidies. Studies in which subjects can not be 

ned random cgji yield tentative guesses of causative chains, but no more. 
Sometimes', these tentative guesses can be strengthened by attempts that show the 
same trends 'exist even after a possible extraneous uncontrolled factor has been 
"partialed out." Thus if an [RS iiT^)] x T experiment shows that low anxiety 
subjects have a more rapidly rising learning curve than high anxiety groups, 
the interpretative or theoretical value of this result may be questioned when 
,it turns out -that the low anxiety group ^liad a mean IQ of 110 and the high 
anxiety group had a mean IQ of 100. "Partialling out" the IQ variable -may 
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restore part of ths credibility of the finding, if the same results are obtain- 
ec However, such results never have the interpretative clarity that can be 
. obtained wh^n "anxiety" is determined from .a manipulated condition rather than 
a- biographical inventory. If several manipulative conditions all supposed to 
produce anxiety, yield consistent result^, clear causative conclusions are 
possible. Unfortunately, longitudinal studies liiust often use organismic variables 
to designate their groups. From such studies many alternative explanations are , 
always possible. 

D. Use of Organismic Variables in Complex Structures 

A fourth use-of organismic variables here must be a catch all category. We 
shall call it 'use of organismic variables in complex structures. This is meant 
to include factor analysis, analysis of covariance structures, and the models 
Jdreskog identifies as LISREL models (JOreskog 5 SUrbom, 1976a; see also chapter 
this volume). The latter refers to a very general model that JOreskog has 
incorporated into a computer program that permits specification and testing of: 
a measurem^ent model of latent^variables in the X's,'a measurement model of 
latent variables in the Y's, and a structural analysis relating the X latent 
variables and the Y latent variable?. This general, structure includes many 
multivariate analyses as special cases. It permits specification of simplex 
/ models on the Y's with X's as additional predictors. 

■ The numerous possibilities are too many, and too complicated to comment on 
here, except for a brief philosophical note. We will be seeing many complex 
models formulated on behavioral data sets. In many cases, the authors report a 
given model, say it is compatible with the data, and let it ^o at that. JOreskog's 
programs permit maximum likelihood tests of specified models, it is hoped ^ 
^that readers will learn to take such tests in a sensible fashion, without some 
of the habits that seem to exist in the interpretation of simpler hypotheses 
tests. One of the most superficial review practices is to take a given area of. 
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contenlf, or a given experimental question, -the^n to obtain 8 1 references on 
that topic and tabulate the number of signmcant differences. In asking "Is 
A greater that B," some review articles say 15 were significant with A>B, 25 
were nonsignificant, so A = B was retained, and 2 were significant with B>A. 
Therefore the A = B's have it, and further research is needed. Such reviews 
often ignore the fact that many of the studies may have had such small n's that 
for any reasonable A-B effect, the power was minimal, and retention of the null 
is quite likely. Until reviewers consider power problems, and the adequacy of 
the experimental design such compilations are of little value. A modicum of 
statistical' sophistication is needed to yield .worthwhile reviews that separate 
the wheat ^rom the chaff, the signal from the noise. 

' As we go to morfe complex models, for more complex questions, still more 
sophistication will be needed. It is xlear that for most sets of data, many 
different models could be built. If n is small enough, the power will be small 
so that almost any model will "fit" in that the null will be retained. On the 
other hand, if n is large enough, almost any model will not fit, in that the 
Chi square on the model fit will be significant because some specified parameter-,^ 
' in the model pll be a little bit different in reality than it is in the model. ' 
Readers who use the "significant versus nonsignificant" gauge as their sole ^ 
evaluation tool for published research are going to be hopelessly lost when it 
comes to the use of complex models. It is difficult to provide guidance rx-Aes 
that will always- apply, but the author would like to add one suggestion. 

It is often very difficult to express the adequacy of fit .of thfese complex 
f models. The more interesting publications are often those that at least, explore" 
,^^,,,,^Vo moa.V- M.uUms. Wooa.. and Nuttall (1973) present an interesting 
' study ba.ca on a very l.r.o n. on the hiorarchial model of Bloom-s taxonomy of 
cognitive objectives. They construct a nodel that knowledge items must be 
mastered before you can master comprehension items, and one must master comprehen- 
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sive items before he can master application items on that topic, etc. They 
compare a model without a general intelligence factor, and a model with a general 
IQ factor, and conclude that the latter is needed to fit the data. Basically,, 
their final model supports the notion of a hierarchial structure from knowledge 
to comprehension to application. However, no heirarchy is indicated for analysis, 
synthesis, or evaluation. Their study is especially interesting because it 
compares several feasible models with each other. {Further statistics and 
further models to be included' may be desired by the Trader; this is a very 
tough problem for the editors and reviewers" of studies testing complex structures. 
We can only ask that authors make copies of their data available to, those who 
request it.) 

To provide at least a minimum 'basis for publication of such studies, it 
would be desirable to know that the experiment at least had enough power so 
that it could reject some "outrageous models." In the Madaus et al . (1973) 
study, it would be possible to reverse the hierarchy and test a model in which 
evaluation, synthesis, and analysis are taken as prerequisites to successful 
mastery of knowledge and comprehension items. That is, an "outrageous" model 
might be one in which the direction of the hierarchy is reversed. If the" study 
" had so little power it was unable to reject this "outrageous" alternative, 
there certainly is little basis for taking the model that was retained very 
seriously. As we get complex models, we must recognize that many, many different 
models may -adequately fit the same data. We can only hope to improve our 
models, much as the physical sciences have done. We must not consider that 
every model that is not rejected is true, or that every model that is rejected 
is useless. 

Rather than continue in this general vein, let's turn to the class of 
models probably used most often in .longitudinal studies, covariance type models, 
'n^e author is somewhat skeptical about interpretations of such models when the 
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X's differ considerably (Games, 1976; Campbell S Erlebacher, 1973), but feels 
that a major problem with covariance usage is that many, or even most, users 
readily adopt a covariance model without first looking at the more general 
models that permit heterogeneous slopes. Even modern computer programs (e.g., 
BMDP2V) do not provide a test for the homogeneous slopes assumption in covariance. 
The following two sections shall illustrate such tests in repeated measure type 
designs. 

IV COVARIANCE TYPE MODELS WITH A NESTED FACTOR AND A REPEATED MfeASURE , 

BUT WITHT TALUES AVAILABLE ONLY ON SUBJECTS , NOT ON EACH , 

• SEPARATE ' OBSERVATION 

In this design, we have only one set of X's per subject. It is possible 
to have several variables in X, as in [RS^w in (A^)] x and such 

designs would be carried out using the steps we will illustrate below, only 
jwith several vectors of X. For convenience, we shall use data with a single X 
vector. Winer (1971, p. 803) has such a set of data analyzed by covariaiice.^^^ 
One of the" assumptions of covariance is that the regression coefficients within 
groups is the same. Winer does not illustrate how to test this assumption on 
any designs with repeated measures nor does any other source the author knows 
of. To illustrate the procedures needed in a more general context, we shall add 
a third (A ) group of independent subjects to Winer's data, ~ thus resulting in 
an [RS.^ w X in (A^)] x design. B is here used, instead of T, to match Winer's 
symbolism. 

A. i_rn»o21 ^!2lli!-l l£L i I^^st of Heterogeneous Regression ,Slopes 

The data are given in Table 1, with various vectors needed for a linear 
models solution with homogeneous or heterogeneous slope solutions. Tlxe first 
three columns are the usual subscripts for the design factors . Column four is 
the dependent variable, Y. There are two Y's for each subject (due to the 
repeated measure factor B with two levels) , here each observation is found in a 
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different row, with the corresponding B level indicated in the third column. 
The unity vector of all I's (for estimation of y^) is column five. The control 
variable, X, is given in the sixth column. Since there is only one X per 
subject, we repeat the X value for each of the two rows of that subject. Thus 
subject 1 has a 3 punched in bo^^ f the first two rows (X^^ =3). The X value 
is given twice for all subjects. Since X varies only over the 'different subjects, 
it can influence only the results on the bet^veen subject factors, A 
and S(A). Columns seven and eight are vectors expressing the three levels of A 
in two orthogonal contracts: -2, +1, +1, and 0,-1, +1- 



Insert Table 1 about here 



Similarly column nine expresses the B +1, -1 contrast as a vector. If 
there were more than two levels of b, we would need (b-l> such vectors, each' an 
orthogonal contrast. In addition, we need vectors for the subjects, but since 
these are bot'h^numerous and constant for any of the analyses we shall consider, 
we shall not flutter up the table with them; they are implied (see Cohen f, 
Cohen, 1975, chapter 10). The final vectors iieeded are for the interaction. 
IVhen we multiply a main effect contrast vector for A by a main effect contrast 
vector for B in a balanced design, we obtain an orthogonal interaction vector, 
as in.columns ten or eleven. Thus we have a set of five mutually orthogonal 
experimental design vectors. 

. If we Mse columns 5, 7-11, and the subject vectors as predictors in the X 
matrix of a multiple regression on Y, we may obtain the usual ANOVA as given in 
Table 2. 

Since the five experimental vectors are mutually orthogonal, we could 
obtain a SS with one df for each vector and these would sum to SS^^^^^. However, 
it is conventional to sum the single df into the usual omnibus SS for a factor 
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or interaction, as given in Table 1.. (When apriori reasons specify a-particular 
interaction or main effect vector as of prime interest, it is advisable to test 
'that one vector alone.) The "summary table" of the ANOVA has ignored the presence 
of the X vector as a predictor. 
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% To obtain an analysis of covariance,-'we merely include the X vector (column 

in the predictor variable matrix of multiple regression. Howler, if we 
insert this one X vector alone, we are assuming that X acts the same way in all 
three of the independent groups of the A factor. We are assuming that the 
subject means lisummed over the B' factor) have the same regression from X \n all 
three groups. Before making such an assumption, it is wise to test. it. 

To test for homogeneity of regression, we add not only column ,6, but also 
- column? 12 and 13 to the predictor matrix^ Given that vector 6 is already in 
the analysis, column 12 is testing H^: 8^ =(82 * 83)72 where the g's are-the 
raw score regression coefficients in the population for the three respective A 
populations, A^, A2, and A^. Similarly column 13 is testing H^: = $3. If 
-both of these are true, then = 83 = B3; i-e-. "e have homogeneity of all 
three regression slopes. The common procedure is to combine these into a 
single famTfyivise test. This may be carried out several ways', depending upon 
the computer programs available. If only ge'neral multiple regression programs 
are available, it may be necessary to punch the data as in Table 1, and obtain 
two different SS (regression)'^ values . 

We can simplify the analysis by ignoring the within subject variables. • 
Tliese are ofthogonal to all of the between subject variables; and only the 
latter are influenced by the between subjects covariate vectors in the present 
design. If we use columns 5, 6, 7, 8, 12, and 13 as predictors for the heter- 
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Spurce * DF 

BTN, Subjects 

A • 2. 

■* * * - - 

S(A)''= E -9 
'Within Subjects 

'ab : \ 

SB(A)'^~BV 9 



Table 2 

« 

^ AOV of Data of 



[RS. w X in (A.)] x B Example 

Analysis of .Variance Table 

it 

Sum of Squares Mean Square* 



83.250' 
^08.88 

• 108.37 
2.2500 
8.8750 



41.625 • 
':54.319- 

« 

108.37 
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0.986y 
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>.25 
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>.25 
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5.00 
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ogeneous A slopes model, we obtain SS (regression) = 339.16 with d£ ~s5. Then 
dropping to the homogeneous slopes model, we would use column^' 5, 6, 7, and 8 
only and obttei SS (Regression) = 328.46 with df = 3. Taking the difference 
between these two SS we obtain the SS associated with heterogeneous slopes = 
339*16 - 328.46.= 10.70. The df is S - 3 = 2, so MS (hetero slopes) = 5.35. ^ 
This should be tested using the adjusted MSg^^^ of the heterogeneous slopes 
model of 8.8269 as MS^, yielding an F of .606. With an £ less than one, we, 
would retain the hypothesif^of homogeneous slopes thus justifying adoption of 
the .covariance model. f 

If th^^gression slopes were heterogeneous, it would be necessary to 
proceed using different regression slopes for each of the 3 levels of A. 
Pr^obably the skimpiest way would be to obtain the subject means of Y^^ ^ (averaged 
over B)'and solve for a separate regressipn equation for each of the thtee 
groups. The procedures are Ulustrated in Cohen and Cohen (1975, p. 314-319). 
If you use the-siriiple Y= ^o/"^-^! ^ ^^^^ ^roup separately, you may insert the 
* value of the grand, mean'of the'X's, X.., to obtain a predicted value of Y for 

each of the three groiipS^vhen X is at its mean value. This plus graphs of the 
. three regression equations will provide us aa&i^ information. The statistical i> 

sophisticated may wi h to use the Johnson-Neyman technique as illustrated in 

Walker and Lev (1955,"-pp. 398-404), or the extensions discussed by Cahen and 

Linn (1971). 

B. A Linear Model for Covariance 

- With" the Sbove results, it is possible to proceed by covariance, usinj; 
vectors 5-11. -in this case, we obtain the analysis given in Table 3. Note- 
that only the-between-subjects factors SS's have changed. Anytime we havo only 
one set*, of X's per subject, only the between-subject factors may change. I » 
this case, the covariate is successful in reducing the error term, MSgj-^^^ 
34.319 in the AOV to 7. 958 in the COV. Thus there wil.l be more power in tlx.- 
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.GOV than in the AOV. This is the major virtue of GOV in a legitimate experiment- 

. al design': tVhen S's are V'ssigned randomly and X is obtained prior to the 

treatments, the X .'s will differ only by random fluctuation. Hence the 
• 3 

adjusted^ . .'s for the A groups will not differ from the original Y .'s by 

• 3 ^> ■ _ 

very much.^ When* the groups are not assigned at random, and the X ..'s are 

substantially different, then we get, into complexities of interpretation.- We 
are then working on' estimates of the -feffects of A when substantial differences . 
an X have been /'partial led out." ..Interpretations are now similar to those of 
partial correlations. 
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Note that the adjusted means of the covariance have changed just slightly 
from the original Y means of Table 5'. The B means and SS have not changed at ^ 
all, since the covariance here may change only the between subject effects. 
The AB interaction SS also is exactly the same, and correspondingly the differen- 
ce between the two cell means fpr a given row of A is^ exactly the same in Table 
■ 4 as in Table 3. Only the A main effects have been changed by the covariance , 
• (the cell means reflect this effect also) . The A main means have changed only 
a little, because the X . differ only by small amounts, as would be expected 
if only random sampling produced the differences. The covariance has now 
increased the precision so the.main A effect is significant whereas it was not 
in Table 2. The Tukey WSD"' value for the A means is 1.9697 so the mean is 
found to be significantly larger than either the A^ or A, means, the latter two 
not being significantly different. 

There are two different procedures that may be used to solve for the 
= '-"adjusted A means.- Some programs and texts solve for the "adjusted mean" as 
" - the predicted Y value using the observed X . of that particular group. The 
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A 2 

S(A) 8 
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B 1 

AB 2 
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''Table 3 
GOV of Data of 
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Analysis of Variance Table 
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14.771 
18.333 
14.146 

15.750 
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511.63 
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1.141 >.25 
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present solution uses the grand mean of 'the X's (4.9167) for all three A groups, 
so the "adjusted means" are the predicted values of Y for that common point. 
C. Linear Models Using More Than One X Vector 

One of the virtues of the general linear model approach is that it readily 
facilitates the use of as many covariates as available, while the conventional 
procedures- covered in Winer (1971), Kirk (1968), Dayton (1970), or Myers (1972) 
become very awkward with more than one covariant. We shall illustrate the 
expanded case by adding a second covariate, X2, to the data of Table 1. The 
new vector, and the vectors generated from it are found in Table 4. These 
should be considered a continuation of Table 1. 



Insert Table 4 about here 



' The heterogeneous slopes model would now use all vectors from 5 to 16 as 
"predictors. The homogeneous slopes model includes vectors 5 to 11, plus the • 
new vector 14 (X,) . There are now four vectors included in the heterogeneous 
slopes model that are not in the homogeneous slopes model. Thus -subtracting 
the SS regression from the two models yields the SS (heterogeneous slopes) = 
8.4974 with df = 4. This value, converts to MS of 2.1244. The new value of 
the adjusted MS_,., error terms (8.9137) when divided into the above MS yields 
an F,less than 1, so we retain the hypothesis of homogeneous slopes, and would 
proceed with the -usual covariance. 

, The covariance table', and adjusted means are contained in Table 5. We see 
that the second covariate has further reduced the MS error term, since it 
accounts for much of the subject variance (within A). The error term has-been 
reduced from 7.96 in the COV with X^ alone, to 5.03 in the analysis with both 

and X2 as covariates. However, while the A effect was significant in Table 
4, it no longer is significant in Table 5. Partialling out X2 removes more 
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Table 4 

Additional Vectors Needed With 
A Second Covariate, 



Columns 



14 ■ ,.-^5 

2 AjX2 

2.00 -4.00 

2.00 -4-00 

7.00 -14-0 

7.00 -14.0 

9.00 -18.0 

9.00 -18.0 

4.00 -8.00 

4.00 -8.00 

7.00 7.00 

7.00 7.00 

9.00 9.00 

9.00 ■ 9.00 

8.00 8.00 

8.00 8.00 

5.00 5.00 

5.00 5.00 



ERIC 



134 

144 



Table 4 



(cont) 



3.00 
•3.00 
6,00 
6.00 
8.00 
8.00 
4.00 
4.00 



3.00 
3.00 
6.00 
6.00 
8.00 
8.00 
4.00 
4.00 



3.00 
3.00 
6.00 
6.00 
8.00 
8.00 
4.00 
4.00 
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variance from Sg^ than it does from SSg^.^^ so the test of the A effect is no 
longer significant. -Those who believe that covariance always will decrease p 
values are in for disappointments. 



Insert Table 5 about here 



The observant reader will have noted that the wi thin-subjects effects SSg and 



SS' , have been completely unaffected by all of the above. This is because the 



AB 



A, X , and X vectors are all orthogonal to the within- subject effects. Thus 
analysis of covariance. when there is just a single X set of values for each 
subject will only influence the between-subjects effects. The within-subj ects 
effects are here reflected by the B main means, (here always 15.75 and 11.5) 
and the differences between the cell means for each A row (here always 4.25, 
5.00, and 3.50). These terms stay the same regardless of any between subject 
' covariat e effect. This same difference in between-subjects and within- subjects 
effects would hold on more complex repeated measure designs exactly as it holds 
here* 

It would be possible^to' add a third covariate vector to the present set. 
However, to test far" homogeneity of regression would require a total of three 
additional vectors, as in Table 5, an'd this would leave zero df for the adjusted 
error term, MSg^^j • In reality, we should have many more subjects to achieve 
stability when using many covariates^, 

V. COVARL\NCE TYPE MODELS WITH ONE COVARIATE VALUE PER OBSERVATION 

(SEVEiULj PER SUBJECT) 

\ 

In this situation, we have the entire^ design available in both the X and 
the Y values. There is one X paiied with each Y. This may be represented in 
our notational fom, by placing the w X tcn;i' after the last term in the design. 

ERIC 



Table S 
CpV with and X2 
As Covariates 



Source 
Btn Subjects 
Reg. Xj § X2 
A 

S(A) 

Within Subjects 
B 

AB ; 
SB (A) 

Total (ADJ) 



DF 

2 
2 
7 

1 

• 2 
9 

23 



Sum of Squares Mean Squares 



Adjusted Moans, Y' 



A, 



13.938 
22.187 
11.125 



339.373 

17.509 

35.238 

108.38 
2.2500 
8.8750 
. 511.63 



9.688 

17.187 

7.625 



8.7547 
5.0341 

108.37 
1.1250 
0.98611 



11.813 
19.687 
9.375 



Y' 



. .k 



15.75 



11.5 



13. > 



1.739 



96.229 



3 

4.25 
5.00 
3.50 



ERIC 



137 

147 



This is in contrast to the previous case where w X was placed after the subject 
term to indicate X's are available only for each subject. Winer C1971, p. 806) 
has an example design that is an [S3 in (A3)] x 83 w X. We shall use these . 
data to illustrate the linear model analyses needed to test for homogeneity of. 
slopes, and the covariance analysis. , 

Winer's data are given in Table 6. The first three columns contain the 
subscripts for the A, S, and B factors respectively. Column four contains the 
X values and column five has the Vs. Unlike the prior example, note that X 
varies from row to row of the sair.e subject. In this design, it is necessary to 
obtain a covariate for the between-subjects terms, (here A and S(A) and a 
different covariate for the within-subjects effects, (here B, AB. and SB(A)). 
' Column six has been created by averaging the two X values for a given subject. 
Column six will then be used in exactly the same manner the X vector was used 
in the previous example, i.e., as the between subjects predictor variable. We 
shall label it here as SX to indicate it has just one value per subject. 



Insert Table 6 about here 



Column seven is created by subtracting column six from column four. It is 
labeled as the WX vector to indicate it is the regression vector\o be used on 
within subjects ef fecf s . (The same results may be obtained by using column 
four as long as all models include column six prior to column four or other 
' columns derived from column four. The use of column seven is desired only to 
improve the clarity of the example) . 

Vectors 8. 10. 12, 14, and 16 are created to r-flect the orthogonal 
contrasts in the design. B is in column eight, the A effects are in columns 10 
and 12. and the AS interaction in columns 14 and 16. Use of a unity vector a^d 
these vectors (plus subject vectors) in a multiple regression will yield the 
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Columns 



A 


S 


B 


. X 


Y 


SX 


1 


2 


3 


4 


5 


6 


1- 


1 


1 


3.00 


8.00 


3.50 


1 


1 


2 


4.00 


14.0 


3.50 


1 


2 


1 ^ 


5.00 


11.0 


7.00 




2 


2 


9.00 


18.0 


7.00 


1 


3 


1 


11. o' 


16.0 


12.5 




3 


2 


14.0 


22.0 


12.5 


2 


1 


1 


2.00 


6.00 


1.50 


2 


1 


2 


1.00 


8.00 


1.50 


2 


2 


1 


8.00 


12.0 


8.50 


2 


2 


2 


9.00 


14.0 


8.50 


2 


3 


1 


10.0 


9.00 


9.50 


2 


3 


2 


9.00 


10.0 


9.50 
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Table 6 

Linear Model Vectors of Winer'; 
. [RSj in CA3)] X B2 w X Data 



wx 


*B 








7 


8 


9 


10 


11 ' 12 


-.5 


1 


-3.00 


_2 


-7.00- 0 


+ .5 


+ 1 


4.00 


-2 


-7,00 0 


-2 


-1 


-5.00 


-2 


-14.0 0 


+ 2 


+ 1 


9.00 


-2 


-14.0 0 


-1.5 


-1 


-11.0 


-2 


-25.0 0 


+ 1.5 


+ 1 


■ 14.0 


-2 


-25.0 0 


+ .5 


-1 


-2.00 




1.50 -1 


-.5 


+ 1 


1.00 




1.50 -1 


-.5 


-1 


-8.00 




8.50 -1 


+ .5 


+ 1 


9.00 




8.50 -1 


+ .5 


_i 


-10.0 




9.50 -1 


-.5 


+ 1 


9.00 




9.50 -1 



SXtj;. 


Vb^ 


^^AP-^ 


*AB2 


^^B2 


13 


14 


15 


16 


17 


0 


+ 2 


6.00 


0 


0 


0 


-2 


-8.00 


0 


0 ■ 


0 


+ 2 


10.0 


0 


0 


0 


-2 


-18.0 


0 


0 


0 


+2 


22 .0 


0 


0 


0 


-2 


-28.0 


'0 


0 


-1.50 


-1 


-2.00 


+ 1 


2.00 


-1.50 


+ 1 


1.00 


-1 . 


-1.00 


-8. SO 


-i 


-8.00 


+ 1 


8.00 


-8.50 


+1 


9. 00 


-1 


-9.00 


-9.50 


-1 


-10.0 


+ 1 


10.0 


-9.50 


+1 


9.00 


-1 


-9.00 
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Table 6 



s 


1 


1 


7.00 


10.0 


5.50 


+ 1.5 


1 

— 1 




3 


1 


2 


4.00 


10.0 


5.50 


-1.5 


+ 1 


4.00 


3 


2 


1 


8.00 


14.0 


9.00 


-1 


' -1 


-8.00 


3 


2 


2 


10.0 


18.0 


9.00 


+ 1 


+ 1 


10.0 


3 


.3 


1 


9.C0 


15.0 


10.5 


-1.5 


-1 


-9. CO 


3 


3 


2 


12.0 


22.0 


1.0.5 


+ 1.5 


+ 1 


12.0 
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(cont.) 















-IT 




1 


5.50 


+ 1 


5.50 


-1 


-7 •UU 


-1 . 




1 


5.50 


+ 1 


5.50 


+ 1 


4»UU 


+ 1 


A nn 

H . uu 


1 


9.00 


+ 1 


9.00 


-1 


-8.00 


-1 


-8.00 


1 

X 


9.00 


+ 1 


9.00 


+ 1 


10.0 


+ 1 


10.0 


1 


10.5 


+ 1 


10.5 


-1 


-9.00 


-1 


-9.00 


1 


10.5 


+ 1 


10.5 


+ 1 


12*0 

• 


+ 1 


12.0 
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"AOV summary table reportedv-as Table 10.6.7'^(ii) in Winer (1971, p. SO?) . 
'A Tests for Heterogeneous Slopes 

Ve^ors 6 and 7 would be added as predictors to yield a COV suJnmary table, 
-.powever, prior to doing this, ,it is desirable to test* for homogeneity of slopes, 
•^ere are two types of regression slopes present in such a design, and they 
must be tested separately since they will have different error terms. Hetero- ^ 
.gjeneity of between-subjects regressions (in the three A groups) is tested us in, 
the adjusteo -'s(a)- h^eterogeneity of slopes o^ the within subjects factors is 
tested using adjusted MSsb(a)- P'°vide a test of heterogeneous slopes an 
the A groups', multiply the SX vector by the A contrasts, yielding columns 11 
and 13. To provide for a test of heterogeneous slopes on the within subjects 
facS«:^^e multiply column seven by the B contrast and the AB contrast vectors. 
This yields columhs 9, 15, and 17. Using a unity vector, and vectors 6 to 17 
of Table 6 in'^one pr more computer runs (depending on the programs available) 
in a process similar to that' illustrated in the prior example yields the summary 
table of Table 7. 



Insert Table 7 about here 

The SS in the SX and WX rows are the sum -of squares of regression associat- 
ed with columns six and seven respectively. (These would, not be included in 
some program outputs.) They clearl> indicate the effectiveness of both covar- 
iants. The main. Interest in this model is whether we may assume homogeneity of 
slopes of the column seven vector over the several within subjects, effects. 

The between subjects homogeneity is tested by MS^^^^ a'''''^S(A) 2.528. Tins 
value has a probability greater than .20, which lead's to a retention of homo- 
geneous slopes of the SX vector on thq three A 'groups. 



Table 7 

Summary Table of the Completely Heterogeneous Slopes 
Model Using Vectors 6 to 17 of Table 6 



^ource 

BTN Subjects \ 
SX reg. 
A 

Het A 

(cols. 11 5 13) 

S(A) 

Within Subjects 
WX reg. 
B 

Het B 
(col. 9) 

AB 

Het AB 

(cols. 16 S 17) 

- Pooled 9, 16 
5 17 

SB (A) 

Total (ADJ) 



DF 

1 

2 
2 



1, 

1 

1 

2 
2 



2 
17 



Sum of Squares 

178.37 
• 54.259 
27.849 

16.522 

62.745 
29.418 
1.1179 

1.9228 
1.8317 

2.9496 

0.46492 
374.50 



Mean Squares 



27.129 
13.924 

5.5072 



29.418 
1.1179 

0.96142 
0.91584 

0.9832 

0.23246 



- F 



4.926 
2'. 528 



\ 



126.551 
4.804 

4.136 
3.940 

4.230 



>.10 
>.20 



<.01 
>.10 

f 

>.10 
>.10 

■>.io 
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There are two different possible Heterogeneous slopes tests for the within 
subject vector, WX. Using column nine we nay test for heterogeneous slopes 
over the B main effect, while using colunns 16 and 17 we may test for hetero- 
geneous slopes- over the AB interaction cWasts. Unless there is an apriori 
reason for believing that these would diffeY, these would be combined into a 
single test of heterogeneous slopes for the ^VX vector over all within subject 
effects. This is shown in Table 7 in the row with the pooled SS from vectors 
9, 16, and 17. This test has a probability greater than .10 (as do the individ- 
ual -tests) so again the null hypothesis of homogeneity of slopes is retained. 
If the pooled test leads to the conclusion of heterogenity, it would be approp- 
riate to test for homogeneity on B, and 6n AB separately. 

B. Co variance Models 

In the absence of heterogeneity, the covariance Chomogeneous slopes) model 
is appropriate. This is given in Table 8. The table differs slightly from 
' Winer's (l971, p., 807, iii) because Winer chose to use the regression coefficient 
• ' for the vector also as the regression coefficient for the SX vector (they 
' were quite close). Tl.e present solution uses the two vectors separately. 
' Ag^in the grand mean of the X's (7.5) is used to find the "adjusted means- as 
the predicted values of Y. In this case, the A main means, the B main means,- 
and the cell means all will have changed somewhat due to th. "adjustment" by 
covariance, since this included regression by both a between- subjects vector 
and a within-subjects vector. 



Insert Table 8 about here 



It is possible in some examples that only one of these two covariate 
vectors (column six and column seven) would have a significant regression, so 
you may wish to go to a simpler model with only one of the two. Since the 

O 1A3 

ERIC 155 



Table 8 

Summary Table of the Covariance Model Using Vectors 
6-8, 10, 12, § 14 of Table 6 and the Adjusted Means 



Source DF 

BTN 'Subjects 

SX reg. 1 

A 2 

S CA) S 

Within Subjects 

WX reg. 1 

B 1 

AB 2 

SB (A) S 

Total (AD J) 17 



Sum of Squares Mean Squares 



178.37 
54.259 
44.570 

62.745 
29.418 
2.5393 
2.9930 
374.50 



27.129 
8.8741 



29.418 
1.1696 
0.59960 



3. 057 



>.10 



49.063 <.001 
1.9506 >.20 



Adjusted Means, \' .. 

.IK* 



12.516 



^2 
16.595 



14.556 



3 



10.526 
11.893 

11.645 



12.474 
14.996 

14.688 



11.500 
13.444 

13.166 
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previous section illustrated the use of only the between subject vector, we 
shall illustrate an example where only the WX vector is retained, and the SX 
vector is dropped. Table 9 contains this summa;^ table, and the adjusted means 
corresponding to it. The between subjects SS's are changed by dropping the SX 
vector, but we see that this has no effect on the within subjects SS's since 
the SX vector is orthogonal to ell within subjects contrasts. For the same 
reason, the Btu-subjects SS's are the same as in the AOV table, and the main A 
means (a Btn-3ubjects effect) are the same as in the ANOVA analysis ignoring 
column seven. With the WX vector, as a lone covariate, the SS's wi thin- 
subjects and the B main means- are identical to what they were in the complete 
covariance analysis of Table 8. The cell means have been "adjusted" with 
respect to the WX covariate also. The general point is that in such an analysis 
of covariance you are always working with two orthogonal sets of effects. The 
between-subjects effects require one covariate, column six, and will be changed 
by it, but the between-subjects effects are orthogonal to the within-subj ects 
effects, and the within-subj ects covariare, column seven. Correspondingly, the 
within-subject effect.s are orthogonal to the between-subjects effects, and 
column six, the between-subjects covariate. Neither set is influenced by the 
decisions made on the other set. 

This kinJ of covariance can be conceptualized as doing two different 
. covariate analyses, one for the between-subjects effects, and one for the 
within-subj ects effects. In each case, we should start by testing for hetero- 
geneity of slopes, and proceed with the covsriance only if the condition of 
homogeneous slopes is feasible. It is perfectly possible to have. heterogeneous 
slopes on the between-subjects portion, and homogeneous slopes on the within- 
subjects effects; or vice-versa. 
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Insert Table 9 about here 



VI. CONCLUSIONS AND SUMMARY 



Itfhen working with organismic variables, one must face the fact that clear 
interpretative conclusioiis are not as easy to come by as when working with 
manipulative variables- The investigator must recognize that the organismic 
variables he has used are correlated with many other organismic variaTjles, and 
it is impossible to be 100% confident that it is "rigidity" rather than some 
other variable correlated with rigidity that has produced the observed differ- 
ences. The limitations of cross sectional studies can be viewed as the problem 
that the observed organismic variable, age, is confounded with other variables 
of educational differences, historical differences, environmental differences, 
etc., of cohorts. This same problem is present, in a different and lesser 
extent, when an organismic variable,. X, is uled in a longitudinal study. 

Although covariance can be used as one method to try to eliminate some of 
the possible alternative interpretations, it is often used incautiously without 
testing even the basic assumption of homogeneous regression slopes. Least 
squares analyses are possible for either heterogeneous or homogeneous slopes 
models, with or without repeated measures. Since longitudinal studies require 
at least one repeated measure, such analyses have been illustrated in the 
present article. Unfortunately, even if all statistical assumptions have been 
met, XL is still a matter of consid^able controversy whether clear interpret- 
ations after a covarii.nce analysis are justified if the X's are considerably 
different. Evans and Anastasio (1968), |erguson (1966), and McNemar (1969) say 
yes, but Cronbach and Furby (1970), Campbell and F.rlebacher (1970) and Games 
(1976) say no. The author thus rccorumends caution in such interpretations, and 
a willingness to look at the data from alternative interpretations. 
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Source DF 

BTN Subjects 
A 2 
SCA) 6 

Within Subjects 



IVX reg. 
B 

AB 

SB (A) 
Total (AD J) 



1 
1 
2 
5 

17 



Table 9 

Analysis of Covariancj with Only The 
WX Vector as a Covariate 



Adjusted Means, Y' 



12.794 
8.859 
13.282 



Sum of Squares 



100.00 
177.00 

62.745 
29.418 
2.3393 
2.9980 
374.50 



^2 
16.873 

10.808 

16.385 



M. in Squares 



50.000 
29.500 



29.418 
1.1696 
0.59960 



14.833 
9.833 
14 . 833 



1.695 



49.063 
1.951 



>.20 



<.001 
>.20 



/ 



..k 



11.645 



14.688 



13.166 
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Most longitudinal studies are investigations, as distinguished from 
.^/experiments (Gaines 5 Klare. p. 442). We must recognize we are mere observers 
/ in situations in which nature pulls a thousand strings. The strings we are 
"watching may not be the crucial ones. Only by careful observation over many 
studies and many situations are the crucial strings likely to be identified, 
and only after they are ide.Jtified are ue likely to learn i.he crucial cues that 
indicate a desired response shortly will- follow. The longitudinal investigator 
needs considerable patience, not only for the collection of his data, but for 
the processes to yield clear interpretations. 
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ABSTRACT * 

Detecting and describing change over time is a widely encountered mbthod- 
ological problem which, given certain design and measurement restrictions, can . 
be effectively solved by analysis of variance and i\s multivariate extensions. 
Polynomial trend analysis is used to investigate the shape of the curve describing 
time-dependency of a population mean and differences in shape between populations, 
when data are cross sectional in nature. For longitudinal, data, analysis of 
population time-point means or diff^erea&i in trend between papulations can be 
carried out by multivariate repeated measures analysis or, in favorable cases, 
by mixed-model univariate analysis of variance. Special data characteristics 
are discussed which lead to very powerful applications of the general models. 
Examples are presented and discussed in which the models are applied to physical 
growth data. 



UiNIVARIATE .^ND MULTIVARIATE ANALYSIS OF VARIANCE 
OF TIME-STRUCiURED DATA 



* Data aV& time structured when the observations can be identified with a 

number of pre-as^igned points on the time continuum. In behavioral studies, we 

» 

have the option of intrpducing time structure on more than one level: to study 
secular change^ in populatidhs, we locate the observations in historical time 
(years, decades, centuries); to describe the growth and development of individual 
subjects within populations, we typically observe the subject at fixed intervals 
(days, months, years) on a time scale originating at his conception or birth; 
to characterize time-dependent response pi^ocesses within subjects, we can 
record the subject's responses during intervals beginning 9x various elapsed 
times (seconds, minutes/ hours) after- the onset of an expeL.mentally imposed 
condition or stimulus- $ 

As a general technique for the statistical treatment of time-structured 
data, analysis of variance is virtually unique in its capacity to detect and 
sununarize systematic time-dependent variation and covariation in observations 
from all of these levels, separately or jointly. In one unified analysis, -It 
can encompass the possibly nultiple outcomes of an experiment represented at 
several points in historical tine, based on responses from subjects at differ^t 
stages of development, ^ and repeated uithin each subject on a number of occasions 
or trials. Given this structure, we could with the aid preanalysis of variance 
and its multivariate extensions, extract the shape of the average response 
curve as a function of trial times, test for differences in shape due to the 
conditions imposed by the experinenter , to the stage development of the 
subjects, or to secular change, and- investigate all possible interactions of 
these factors. v 
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Even in such co.-nplex applications the analysis of variance approach is 

surprisingly modest in its demands on mental effort to formulate the problem 

and on computing resources to perform the calculations. This conceptual and 

computational economy is not, however, purchased without a certain price. 

Because analysis of variance is part of linear least squares (Gauss -Markov) 

estimation, it requires simplifying limitations and assumptions for a straight- 

forward and exact analysis. To benefit from the advantages, we have to be 

it- 

, cognizant of the limitations. We must not attempt to extend this general 
purpose technique into realms where more specialized methods (often involving 
non-linear estimation) are required. Obviously, we must begin our investigation 
with the plan of the data analysis and its restrictions clearly in view. Some 
of the points to be considered at the planning stage are discussed in the next 
section. 

I. ASSU?-fPTIQ\S AND LIMITATIONS 
• - - • - 

-For tine-structured data to be accessible to analysis of variance, not 
only must each' obserxation carry a time identification, but the method of , 
measuring response, the ^.mplin^ plan, the arrangement of the time points, the 
assumed form of tine-dt- pendency , and the nature of the error distribution must 
be restricted in cert:ui ways. 

> 

^- Interval M easi ir cnvnt 

If the oh\: t of t'le .inaU'si < is to iescribe svstematic trend over time, 
it is mandatorv that the response variiSIes be measured on a scale whose units 
are connensura te t^roli^'^■">:^ tf;o roIeva*^.t range or variation--i .e. , the measiV^e- ^ 
nent must be \ ti-cilicJ *inter\?.r' b^le v,ith unit^; everywhere of constant 

size in some j1 j ' ^-n^o. Or -iC r'-r : , thr sliape of the trend line is 

r 

^ arbitrary, Ntrai-'^.t P: c.i:'::^'t 1 1 > "/i-'^'^ frt-r^ curvr.s, and pirallcl 

lines at diff^-rent ti'-itl > Mr irilP-K Fv.-n uhen the r *asures 

are l^noiv-n lo b:^ ^ ' l^' " ^' • - '.mk-w a. \\r .^enrineter, 
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seconds), it may be desirable to transform them to equality on another scale in 
.order to see cicariy the essential form of the trend line. For examplp, variables 
measuring exponential growth may be better analyzed in log units rather than 

the original units. ^ 

The problem of commensurate units can be especially severe when the measures 
arise from behavioral responses. Bock and .Jones (1968, Chapter 1) discuss the 
issue of defining measurement 5caJ.es for behavioral data that have some (Jf the 
properties of,, for example, the. e.g. s. system in physical measuremen-L . They 
point out that physical units are intrinsically defined not by the method by ' 
which the measurements are taken, but by their role in the mathematical models 
that connect one obser^/able phenomenon with another. Thus, the units of length 
take on meaning when the formula for computing area can be used at every point , 
on the scale of measurement, and that area can be used tS translate pressure 
into force in terms of units of mass, and so on. Specifically, it is the 
invariance of a great variety of mathematical models with respect to location 
on the measurement scale that gives meaning, utility and generality to systems 

such as c.g..s . ■ 

With admittedly weak .theoretical underpinning, we can perhaps accei5t as 
having units any behavioral measurement scale that has a viilidated linear 
re:ationship with another variable of interest. By this criterio-n we might be 
willing to accept the Binet I.Q. scale as interval measurement on the grounds 
that in the- interva> from five to fifteen years it exhibits a linear relationship 
with many other physiological and psychological indices of maturation. To the 
extent that Binet I.Q. diii.cences translate proportionately into increases in 
these measures, the assumption that the F.Q. scale has well defined units is 
not entirely^ t^ratuitous. , 

'■lUit stvon^ior ilcfuution.; of hchavioral scal<-.s arc possible. Bock and ^ 



Jones (1968) consider Thurstone's psychological scaling, to. be interval measurer 
ment defined by related response models. They present a number of models for • 
judgment and. choice , that are connected by a common scale-and, using units on . 
t^is scale, perform analyses of variance of factorial models for sensation and • 
preference. In much the same sensef modern psychometric methods of latent . 
trait measurement produce scales with commensurate units by defining a model 
relating differences on the'scale to item-response probabilities (Bock, 1972;- 
Lcrd, 1974; Rasch, i960;" Samejima, 1969 ). These scales appear also to yield 

linear relationships with other variables (Andersen, 1976; Bock, .1976; Bock and 
Thrash, 1976). Because much of research on human behavior at the individual 

level depends on objective test instruments, it is of considerable interest 

that latent trait theory can open this domain to statistical methods, such as ^ 

analysis of variance, which assume interval measurement. 

B, Group- Comparisons 

If a straightforward application of analysis of variance is desired, only 
estimation or comparison of group means should be considered. The questions 
the investigator can ask of the data are limited to those concerning the shape 
of the curve of population means as a function of time,, or differences between 
the means of two or more populations as a function of time. IVhether or not 
these are interesting questions depends critically upon the practical, meaning- 
fulness of group averages. It has long been recognized that such averages are 
not completely informative about individual development. A.x,Lell-known example 
is the unsatisfactory characterization of the adolescent growth spurt in plots 
of mean stature versus age.' . iVe spurt is apparent in such data, but few if any 
subjects follow the nean cu'rve.in their own growth. 'ITie group mean curve tends 
to sjiow a more g^^X^ spurt "because of the averacing of individual growth 
spui-ts occurri^^ at different times. "But even this' generalization is not 
entirely tnie be.au.u there arc sone subjects. osp.ecially amonj- the i-ovs, .ho 
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show a more gentle and protracted slope than is seen in the average data. 

The positive thing that can be said of average data is that, if there is 
some weak but consistent trend in the population, the average growth curve may 
detect it whereas the examination' of individual growth curves separately may 

not. An example of this phenomenon presented in Bock (1976) suggests that, 

i 

without resort to advanced treatment of individual growth curves including non- - 
linear models and Bayes estimation (see Bock,. 1976), the ^investigator will l;)e 
limited to characterization and comparison treads of group averages. 
C. Fixed Time Points 

'Analysis of variance can be applied conveniently to time-dependent data 
only when the time points are fixed in advance and are moderate in number. In 
studies where chronological age is the time variable, this^ requirement can be 
met by measuring a subject at pre-selected ages. In growth studies such as the 
Pels or Berkeley studies, for example, the children were measured on or near 
' their birth dates or, at younger ages, at their year and half-year anniversaries. 
If this degree of pre-planning is not possible, the subjects will have a more 
or less random distribution of .age at the time of measurement. For purposes of 
the analysis of variance, the data must then be grouped into age ranges and the 
mean or median age used to represent the ^roup. In educational work, similar 
use of grade-in-school as a time p^int may be defended on grounds that the 
relevant dimension for growth of achievement is years of schooling rather than 
chronological age. Although not a mandatory requirement, it is also convenient 
for the time points to be evenly spaced. As we shall see, the analysis of 
variance of trend is then more easily carried out. 
D . Short-term Moderate Chan ge 

For a number of reasons, analysis of variance techniques may become difficult 
to apply when there .art? many tip.e points encompassing substantial change in the 
■ variables of interest., riiis is rfot simply r- matter of the computational labor 

'"icy 



in analyzing designs, with many 'time points, but one of increasing difficulty in 
justifying the assumptions of conventional trend analysis. As discussed in the 
next section, we typically use a low-degree polynomial to represent group mean 
curves and differences in mean curves. This is quite satisfactory for short- 
run change, but may not be suitable over a wider range. The curve for average 
growth in stature, for example, has no very satisfactory polynomial represent- 
ation over the entire growth cycle. 'Only non-linear models such as the two- 
'cbmponent logistic model of Bock, et al. (1973), or the three-component model 
of Bock and Thissen (1976), seem capable of describing growth in stature from 
near birth to maturity. ' Fitting and testing of these models requires non- 
linear estimation and cannot be approached by the elementary methods of univariate 
or multivariate analysis of variance discussed here. HoweV^er, growth over a 

more limited range can be so described, as will be apparent in the examples in 

I 

Sections III and^IV. _ • . ' 

E. Freedom From O utliers 
—( 

Like all least-squares techniques, analysis of variance is adversely 
affected hya few aberrant observations far removed from the main body of the 
data. In behavioral and biological measurement, such aberrant values are 
almost always the result of clerical errors, or of 'subjects 'in the sample who 
do not actually belong to the' populations sai^ipled. Fortunately, outl-iers are 
easy to detect when pre-screening the data and can be removed from the sample 
before the analysis begins. - 

.To -justify linear- least-square estimation in terms of unBiasedness and 
.minimum variance, it is only necessary to assume that the error distribution 

has finite mean and fin-.e constant variance throughout the range of easurement. 
. (The presence of outliers indicates that the assumption of homogeneous variance 
has been violated.) To justify tlre'nomlnal error rates of the significance 
tests associated with analysis of variance, it is necessary to add x.ho assumption 
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of normally distributed error or large-jsample assumptions. Because many of the 
measures used in behavioral studies are essentially additive combinations of 
many more or less independent sources of envi^nmental , biological and phy- 
siological variation, the assumption that a normal error distribution, after 
systematic effects have been absorbed into the model, is broadly justi^ed. 
The only notable exceptions are response- time measures, which tend to have a 
log-normal rather than a normal distribution. In many applications, the logarithms 
of response times are satisfactory quantities for analysis of variance (see 
Thissen, 1976). 

II. TYPES OF TIME -STRUCTURED DATA 
Insofar as it affects the method of analysis, the main distinction to be 
made is between cross-sectional and longitudinal data. 
A. Cross-sectional Data 




In cross-sectional data, different subjects are sampled at each time point 
and all measures in the sample are assumed to be statistically independent As 
a. result, in the crossed design of (experimental or sampling) groups x time 
poii.wS, the observations are independent both within and between cells, Tliey 
may therefore be analyzed in a conventional two-way ov multi-way analysis of 
variance with but one feature particularly related to time dependence--that in 
th$ partition of the sum of squares for the time way-of -classification and its 
interactions, single-degree-of -freedom terms arc isolated for •'each component of 

trend. . ' 

If proportionate numbers of subjects in each group appear in each time- 
poi^t class, a straightforv.ard orthogonal analysis of variance applies. If the 
^numbers aie disproportionate, a non- orthogonal analysis will be nece:;':;ary and 
will require the investigator to fix the order of the partition of sum of 
squares by choosing an order of priority among hypotheses aboi t various effc:ts 
in the model. This issue vviU he clarified in the discussion of nnaly-.i:. of 

Er|c . . 171 



variance of cross-secti Jnal data illustrated by an example from anthropology, 
presented in Section III. 
B. Longitudinal Data 

Time-structcred data are longitudinal wh^-n each subject is measured on a 
scale commensurate at each time point. Note that, while a longitudinal study 
resulting in this type of data is prospective , not all prospective studies are 
longitudinal or even time -structured . A study that obtains one set of measures" 
at an earlier time, and a second qualitatively distinct set at some later^time, 
is prospective and may enable prediction of later characteristrcs from earlier. 
" But it is not longitudinal or time-structured, does not describe change or 
growth over some per^o^'. of time, and cannot be subjected to analysis of variance. 
Longitudinal studies are both prospective and time-structured, enable both 
prediction and description of growth and change^.and are amenable to analysis 

of variance • ^ 

The analysis of variance of longitudinal data is more complex and interesting 
than that of cross-sectional data. In the psychologicalNind behavioral literature, 
the statistical treatment of longitudinal data is often called "repeated measures 
analysis" (Bock. 197S. Chapter 7; Winer, 1971). In the biometric and statistical 
literature, thi^ topic is usually referred to as "analysis of growth" or of 
-growth' curves"' (Khatri. 1966; Leo. 1974; Pottoff 5 Roy, 1964). Basically, 
three forms of repeated measures analysis have been proposed: 

1) Mixed-nodel univariate analysis of variance (Lindquist, 1953; Winer, 
1971) . 

2) Unweighted (exact) multivariate analysis of variance (Bock. 1963). 

3) V.eighU'd (iar-4e-sanplc} nultivariatc analysis of variance (Khatri. 
196o; F'ottoff T, Roy. 1964). 

" The choice-anon. th.-.c ncthods depends upon the nature of the time-dependency 
and on the stmctnre of the var rinoe-cuvariance matrix of the residuals from the 

fitted trend line. la r.:..t ca.-.c"., tin, choice can be made only after .one 

s 
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preliminary inspection of the data. How this inspection is carried out and the 
- subsequent analysis performed is discussed and illustrated in Section IV. 
C . Other Characteristics of Longitudinal Data 

A sometimes troublesome limitation on the inultivariate analysis of long- 



itudinal data is that the data foi 
recent work on the problem of mult 



each subject must be complete. Although 
^^2^ajx5^wi\fe incomplete data appears promising 
(Kleinbaum, 1973; Rubin, 1974; Trawinski 5 nax'gmann, 1964), the practical 



implementation of these developments is still several years off. 

In the nieantime, the investigator faced with missing data has the option 
of (1) omitting subjects with incomplete data records (if this makes the experi- 
mental or sampling design unbalanced, a non -orthogonal multivariate analysis of 
variance will be required), (2) proceeding under mixed-model assumptions with a 
non-orthogonal vinivariij^Q anal>si& of variance (because subjects must be included 
as a way-of-classif ication in this analysis, the computations will be extremely 
heavy if the nu"iber of subjects is large), (3) using some method of interpolating 
' data points if relatively fe\^ records are incomplete. Considering^ the problems 
that may a;ttend any of the.^e options, the investigator is better advised to 
expend his enev^y on collecting conplete data initially than to attempt a 
patch -up later. 

As a prcfice to the discussion of statistical methods, it should perhaps 
be mentioned that, exc-nt in the simplest cases, the computations will require 
the use of a fairly lar,;e-scalc computer program. Of the several multivariate 
analysis of \ari>ince pro.^ra.'no available, the MULTIVARIANCE program of Jeremy 
Finn (1974) 'is tr c ro.-t con\ anient for repeated measures analysis, and Version 
VI, "ch is in proL:i\?5s, greatly extends this facility (Finn, 1976). (The 
cxar in the present paper were prepared with Version V.) A discussion of 
the use cf the V'JI/ri\ '^IM pr ',:r.ri the anily:>is of time-structured data 
rippoiM in I Miu Malt -on 
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III. ANALYSIS OH CROSS-SECTIONAL DATA^ 
In studies of human growth and development, limited time and resources may 
leave the investigator no option except to collect cross -sectional data. A good 
example are the measures of height and weight, collected by Haller, et al. 
(1967) and more recently by Jamison (1977), among children indigenous to the 
Alaskan North Slope. Although purely cross-sectional, these data are quite 
adequate to check un anecdotal reports that these children grow more slowly 
than children living in the south 48 states. An analysis of some of Jamison's 
results in comparison with a control group of children the same age is presented 
in the computing example at the end of this section. 
A. Form of Cross -sectional Data 

Cross-sectiorfal data may be represented in the form of a so-called "crossed" 
analysis of variance design (groups-x occasions) sho^vn in Table 1. Note that 
the necessary limitation to time points identical for all groups, is represented 



Insert Table 1 about here 



in Table 1 by the recurring value of x^. Note also that the numbers N.^ of 
independently sa.-npled subjects in the group x occasion subclasses are not 
necessarily assumed equal-indeed, a non-orthogonal anal)^sis of these data is 
still possible even when some of the N\j. are zero. 

The sa-nple statistics requir.^d for least-squares analysis c/ this form of 
data are the subclass means y .^^ = -'iik^'^^ik 

the subclass nunbers N., and the pooled within-subclass variance estimate, 

J 

n •:. ^i'^ -"^ 



TABLE 1 

Forrii of Time-Structured Cross-sectional Data 



Groups 
j 




Time- 
points 

\ 


Observayons 

yijk 
(i=l,2, • • -jMi]^) 






^1 


^iii 






^2 


>^il2 


1 




» 

X 

m 


• 






^1 


^i21 






X2 


^i22 



2 
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n m 
where N = E E N 

j^l k=:l jk . 

The first objective of the data analysis is to choose the linear niodel 
that describes systematic effects in the observations- The criterion for this 
choice is one of plausibility and parsimony--namely, that the model should 
comprise the least number of effects that accord with theory concerning the 
phenomenon in question and with acceptable fit of the modal as judged by a 
formal goodness-of-fit test. 

The second objective' is, given the data, to estimate the effects and their 
Standard errors, to compute from the estimated effects the expected trend lines 
for the groups, and to show the expected dispersion of observations about the 
trend line, possibly in the form of a tolerance interval for a new observation , 
at given time points. The first step in reaching either of these objectives is 
to formulate a class of models for time trend. 

« 

B. The Polynomial Model For Time Trend 

If some interval -measured time-dependent variable y has been observed on 
subjects at successive distinct fixed time points Xj^, k=l, 2rr..,in, and m 
is not too large nor the chatige in y discontinuous in this inte'rval , a suitable 
statistical inodel for time trend is the q<m degree polynomial with additive 

error , ' . - 

y>= 3^ + &i X + Spx ^^/^ + e . (Ill- 1). 

The random error, e, is assumed to be inJependently distributed wi.th mean 
0 and unknown variance, o^ The 6's are in general unknown, but may be estimated 

1 ^'^ V 

from the means of the observations at each- time point, > = -<r 

' j ' 

by the so-called Gaus-- -Markov (lea i- squares) estimator, 

(X'DX)'' X'Dy. , for iX'UXj. s^O , CHI. 2) 



where = lS.o , Bi , 82 , . • • . 6^^] , 

X: - iy 'I' y • 2' • • • ' >' ' 

D = diag N2,.--. \] 



and 



h I 
i 

q 



! 1 



m 



m 



(111.3) 



The mx(q+n matrix X contains the leading q+1 rows of the Vanderraonde 
matrix of order m. Since X ib of rank q-1 when all x are distinct (Browne, V 
1958), |X'DX| ^ 0 in general. Tne expected value of this (unbiased, minimum- 
variance linear) estimator is 6 and its sampling variance-covariance matrix is 
o^(X'OX)"^ (see M5MBR, Sec. 4.1). 

Although satisfactory in most other respects, this method of fitting the 
polynomial model by estimating the 6's has the disadvantage of requiring the 
degree q to be specified in advance. In general, all elements of (X'DX) ' ^nd 
of 3 chmge uhcn coluT.ns are added to or deleted from X. Yet in many cases the 
invest i;.itor i> uncertain ibuut the least-degree that will give a good account 
of the data anJ -lil ".vibh to inspect the -oodness-of-f it of several succes<=ively 
lower-degree rvi.'.elb botore deciding. 

fo faciKt-ite thj s for:, of stepwise testing of polynomial models and to 
D.iKe the calculations ea.sier, Pisher (1921) introduced a method of reparamet- 
^^^^ ng (11' !• •' a '-called ortho''.on--il polynomial 1 model. The rcparameter- 
i-.ition i^ cq'ii.a..Pt to -ipplyirv. t.. x : r.ram-Schmidt orthogonalization with 



wotking to the right (see MSMBR, Sec. 2.2.4). The result is to decompose X 
into an mx(g+l) orthogonal matrix P and "an upper triangular matrix S'. This 
is, ' . - 

X = PS' , (111.4) 
t- 

where P'DP = I and X'DX = SS'. 

Then (HI.l) maybe expressed in teras of the orthogonal coefficients 
Y = S'g, which are estimat'ed from the group means by 



Y = P'Ov. = u 



U 1 



UI.5) 
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The elements of the (g+l)x 1 vector u ha\?e expected value S'£; their 
variance-covariance matrix is the (g^l) x fg+l) identity matrix- -that is, they ^ 
have unit variance and are uncorrected. The convenience of this parameterization 
is due to the implied -statistical independence of the orthogonal estimates when 
the observations are normal ly distributed and to the "fact that S' is upper 
Lviangulur with strictly positive diagonal elements. The former property 
implies that, on the hypothesis that the corresponding orthogonal coefficient 
is null, the square of each element in u is distributed independently as -a 
central chi-square on one degree of" freedom. The latter implies that accepting 
the null hyiwthesis for the last orthogonal coefficients Ls equivalent to 
accepting q^^ = q-q, for the degree of the polynomial model for trend. Together, 
' they justify the avera^^ing of squares of the last elements of u for use as 
the r.u.T.crator r.can-square of an F statistic testing goodness-of- f it of the 

df^pre^ a oolvnoinidl vs. the deerce q polynorr.ial . The dcno^nlnator is either 
"1 • ' 

the within-group nean-iquare or the residual rr.ean -square for the degree q model 



1 / n 



group sum of squares. The calculations involved in this test are summarized in 
Table 2. If on the basis of this test, the degree model , 



■vj 
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is adopted, the q^ +1 estimated coefficients of the polynomial are given by 



wLre S^^ is the leading (q^^l)x(qj^l) submatrix of S. and u^ contains the 
4ading q+1 elements of u. The variance-covariance matrix of this estimator is 
a (S' )~ S^'j^. The error variance, a , is estin^atecl by the denominator mean 
square in the goodness-of-f i t statistic. r * ' * 

But it is not aiwayi> nev:es:^ar> to compute tho 'e^Umatc.d B- coefficients. 
In most case^. the trend line ^an be plotted from the fitted values at the 
assigned time points, and these may b- computed froni t-he orthogonal estimates 
by ' 

. y - p,-.,, . ■ _ (HI. 7) 

whe^e contains the Ica-mg q^-i c^iurns of v. Siniil'irly, the tolerance 
interval for i new observation at the p.nnt x. is 



"where' IP 1 " i^ th(^A-\h row of P 'uritrm a col.n n' (S^-p M^MRR 
I j ■ • ^ • 

n, The FLsher-Tdh ebv-cheff Ortjio^orril PolynonLiU- 

Thr true itorU of I ishor's ru^thoi of t ^ttmj: ^ - 



.111^ 



TABLE 2 



Cross-sectional Data: Analysis of Variance for Testing the 
Fit of a q Degree Pol>Tnomial, Given that the q Degree 
Model has Been Found to FLt. The Regression Sums 
of Squares are Computed From the Orthogonal 
/— -HBTtimates u = P* Dy. 

J • 



1 Source of 
Variation 



Degrees of 
yreedom 



Sums of 
Squares 



F-statistic* 



Constant 



Linear 



ssm = u 



Quadratic 



q^ degree model 

q degree model , 
given q^ degree 

Between -groups 
residual 

Group means 



m-q 



^1 



a 



2 

ssr, ^ u^ 



sse ss^-ssr^-ssr^-ssm 



m 2 
<;c;(T = j; N y 7, 



Within groups 



ssw^ ~ Sbt-SSg 



Total 



r.i 



1^ = 1 1^1 



*or (s^rVqJ/[---v/fN-nO] 



X -X is const mt rav 1 , 2. . . . ,n- 1) For' then, > Ls invariant with respect 
j + 1 'j 

to t!\e -igin and^ui>irt$ of the time deasure and is, in fact, precisely the 
tabled l-isher-Tch^by:hof f ortho>Tonil pol>-noniial . Provided the values of -x 

s 

/ 

belong to the- rational nunbors. -the eldnents of P are rational and may be given 

in integer form with respect to a largest common denominator, as may the square 

of the normalising constants for the colums of P. As a result, the orthogonal 

estimates can, for given data, be ^onpute4 up to the limit of the tables without 

any roi-nding error whatsoever. Similarly, the matrix. S may be tabled in integers 

and inverted in integer operations to obtain estimates of 6 without error. 

TTiUS, the problem of round-off error, which plagues least-squares fitting of 

r- ^ 

high order pol>-Tio:niarl s (V.a.Tipler, 1970) i5 completely \fOlved if the orthogonal 
polvnoi^ials are used.. Pae tables given in MSMBR, Appendix B, for pol>Tiomials 
UD to q=9 incluio'the inte-.er for-^ of the P matrix, the normalizing constants, 

4 

and the S natri.... 11 oy ar- con\.enient for othogonal polynonial trend analysis 
i.her ^'le mrnher of t r c p-'M^t. djes not exceed 10. Tor greater nunber.s of ^ 

p.^.jti^, the V-L :rv fl'j:>*M F i >h.:r-\ it'S (19o5) tables are available. 
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; ;i ;p i/-M.-h, say, m ti:ne points are equally . 
1 \\ ' itrix jf orJer n nay- be incorporated into 



tb^-r '.vavs 



th- TUlv -i^ : \ - t ^ r^r-e : > up t ; <\x\\\\<' deoroe-o f- f reedorn components 

, r > - , • . - J'- p^K^n and for it interaction wuli thXi - 

iV..-r->^^ .-1 t'^^ d': 1 xccpi- ' >r the additional *vays of 

f ;r , tiLi > ^'1/ is sinilar to that shown In Table 1 

. !'i M/- rjinorical illustration to folhnv, the 

, I -» t'.r-'" th^ r(M'inuni t i(^> fro.n v;hich th*; 

^ 1 ' > 1 . r'. . • -'-^fleet d i i*f erencc s in th'- ethnic 
,;oI t;^ ^v.... . '.nj :rrrr r cla Med by sex, arul by yelr^ of r^u^. 

... - i ^i^lot^^;' X *A<^.e crH;->-cias ification 



c las J if iCvi 1 1 



:>ubio.t^^ ar- 



Using the conventional nodel for crossed designs (see MSMBR, Sec. 5.3), the 
parameter space of the r.oJef, and corrcponJing suns of squares in the analysis 
of variance is partitior>-d into the fdHowjng .sub^paces: General mean, Location, 
Sex, Age, Location x Sex. Location x Age, <ox \ \ge, and Location x Sex x Age. 

The purpose of the analysis of variance for this type of design is to aid 
in the choice of the least complex model for effects of the sample classes (in 
this ccse the Location -xod Sf>x cToups) and the lowest degree model for polynomial 
trend in any of these effects. If -here is a significant way of classification 
in the analysis, roe corresponding parameter space is retained in the model. 
If there is a si -r.if icar.t ^■•o-f-^ct'^T i nter?ction involving a given way of 
cli.^sification, then the two-factor space and the main class space of that way 
of classification i rr>*airpd. Similarly, if there is a significant three- 
factor interaction involving a' given way of classification, the spaces corre- 
sponding to l:..;, l.l.racticr.. to the f..-c factor ir.teractions involving that 
classification and ti e r.am class space are retained. And so on, to the highest 
order of interaction. 

In any i.-.-^-c - ^ if - -.jV.,-..-^ ... ........... - ^^vwi 

way of cl-^^'^-' ^'"^''^ '^^y "'^i" Class or interaction space, then the q, 

def.rce polyn..'..:! . - - in all r.-....., involvirv that way of classification 

'when ---itLi..". ..'1 - - VrrnJ in t/. data is depicted by computin:^, from. 

-hcVltti^'l ,T:,-o;i:;l. the !nir.:inai or .-roup r..ean . required for 

plottir,, int.^ra.r-: n ' ■m-cla.. .^-f-c:.. a:, a: Topri-.t,-. A plot trend 

) ; - , u t!l u^.-"ioe3 cntci' th- ni*jJ-l Kiu..t be '^pjcificd 
port lorMto) . w.-', J ^..i^ > 

by the iiive:>t . . '.L r. .-i . '^.,> 
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provides a critical test of the more dubious effects, unconfounded by effects 
that are presumed to exist and are necessary in the model. 

In the case of the- Location x Sex x Ago design, age effects are a foregone 
conclusion, sex effects are always possible, but there is little prior knowledge 
about location effects. If interactions are considered less certain than main ^ 
' effects, a reasonabJ • ordering of spaces for the analysis of variance might be:. 
Mean, Age, Sex, Location, Age x Sex, Age x Location, 
Location x Sex, Age x Location x Sex. 
When there is ambi.guj.ty as to the ordering, the analysis may be carried in 
more than one order. But such analyses are in general not independent and 
should be held to a minimum to avoid incurring Type I errors considerably more- 
frequently than their nominal rates. 

I) LX^XMPLE 1: Crosi:^ectional_coj^^ 

aged_ 6 to^ 14 years from two populations 

To illustrate the analysis of variance of trend in cross-sectional data-, 
we compare sor.e data reported by Jar.ison (1977) giving the stature ct Soya 
girls age 6 to I I y. .rs fron Ihe viilr...c. Barrow and Wainwright, 
with d-ita of TudaenL.--. and SilyJer (iJS;, P. 199) for boys and girl. ir. rhc 
Bt-rkelcy (;ul..I.nce Sta.iy. -Stri .tly ^v'^-^^-^si,, this is not a rigorous anaiyt,!^ 
because the rierkele/ J-ita are actually Icn.MtuJinal f.nd will be analyzed 
iongicuiin.lly '-n Ivr,.;.]., 2). But it cl.nfics the calculations and giv<^s so.e 
-indication of x\ - result, rint n ;!..t b -> ^-CK-cted iVo-n actual cro..-.c.tioual 
dita. 

. , V.,. .., ' I- t^-*- calculations are shoi-Ti in Table 7>. 'I^ie 
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Insert Table 3, about here 

sample standard deviations reported in the original sources. 

'fhe calculations outlined in Section III- wore carried out on these data by 
me?..s of the MULTIVARI.^N'CE program (Finn. 1<)74) . This program provides both 
the non-orthogonal analysis of variance and the orthogonal polynomial trend 
analysis required in this problem. After the terms to be retained In the model 
are chosen, the program computes the estimated orthogonal polynomial coefficients, 
•and the predicted values for the mean-trend lines for the groups. 

In this application, the groups are cross-cl.ssif ied by location (Nort^i^ 
Slope. Berkeley) and by sex (-.nale. female), and the between-group and group 
occasion interaction degrees of freedom are partitioned accordingly in the 
analysis of variance shov«. in Table 4. Note also that degrees of freedom for 
pol:momial trer.d of hi.Vner degree than quartic are pooled in this table. 
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3f the analysis cf vaiiance in Table 4 a^e clear enough, with 
one minor 'exception. Ihere is sone evidence of Location x Occasion trend 
.ffc.ts r : degree S through ^ fp-.O!-,;. <^ignificant high-degree orthogonal 
pol>T.o-ial . .-,;-nc:U5 amx.t always .ndicite the presence of one or two irregular 
noi'nt< in CP^ .i>ra. ^fton heoau,- of procc-durai or clerical criors. From the 
plot of the g-ou^. u-m, in figure 1, it ippean^ thut age -roup^ 10 and U ^rc 
^ . i:^, i.-^K K.... ^.r. 1 .Tivi^ in f.m^^(^n«; (lit 11 . 1 h r • is undoubtedly due 

to non-rando'-t ..^n^Jia a,,.,.....i ^ - , 
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TABLK 5 

Mean Stature (cm.) of Boys and Girls Aged 6 Through 14 
North Slope and Berkeley Samples''^ 



North Slope 



Boys 
Mean 



N 



ii: 22 

117.. 15 

122.4 15 

129.9 20 

1^2.2 23 

157.9 14 

i;4.i 26 

} ic; 1 M 1 



Girls 
Mean 



N 



113.4 11 
118.2 22 
122 . 5 
129 2 
130.1 



1 17.2 
iSS. i 



19^ 
22 

r6 



157.6 18 



19 



Berkeley ' 



Boys 
Mean 



ir7.5 66 

124.0 66 

130.1 66 
135.9 66 
141.3 66 
146.5 66 
152-2 66 
15S.8 j 66 
165.8 "1^6 



Girls 

Mean N 



117. 2- * 70 

123.4 70 
"l29.2 70 

135.2 70 

14-1.0 70 

147.6 70 

154.5 70 
159.8 70 
163.1 70 



TABLE 4 



Cross-sectional Trend Analysis of Average Stature of 
Children Aged 6 Through 14 from Berkeley, California, 
and the Alaskarf ^iorth Slooe (Age x Sex x Location) 

( [ 



Source of 
Vi?riation 


d.f. 


Suin of 
Squares 


F 




Generjil Mean 


1 




V 


> 


Linear Age 
Quadratic Age 
Cubic Age 
Higher Age 


1 

1 
1 

5 


336,242 
11.96 
4.48 
1 98.91 


8666 
.30 
.11 
.51 


<.0001 
.'"8 

. 74 
.77 


Sex 


■ 1 


6.11 


.16 


.6y 

« 


Location 


1 


" 15,766 


406 


<.0001 


Lin. Age x Sex 
Quad. Age x Sex 
Piihic* X Sex 
Higher Age x Sox 


1 
1 
1 

5 


36.75 
73.55 
319.40 
.190.36 


.95 
1.90 
8.23 

.98 


. 35 
.17 

.004 


Lin. Age .\ Loc. 
QUad. Age x Loc. 
Cubic Age x Loc. 
Higher '\ge x Loc. 


1 
1 

1 

5 


1,004.6 
18.75 
.002 
. 457.35 

o 


25.89 
.48 
. 000 
2.25 


< onoi >. 

.49 
.9? 
.046 


Loc. X Sex 


1 


2 .25 


.55 


.46 


.Ag^x Loc . \ Sex 




140.97 


A r" 
. MO 


.39. 



Within Croups T^ns 



/ 

/ 
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If the significant higher-degree Age x Location interaction is discounted, 
the only significant greater-than-linear effect is the cubicAge x Sex inter- 
action (p=.004). Because girl? reach mature stature bef^^e boys, this type of 
interaction is to be e .pected as '"he children enter adolescence. It is clearly 
seen in the group means in Table 1 as an inversion in the order of the means 
for the two sexes in the Berkeley data. ITiat there is no similar inversion in 
the North Slope data might suggest an Age x Sex x Location interaction, but the 
analysis does not confirm its presence. 

If the cubic Age x Sex r^rm is included in the model, the Sex main effect 
and Age main effect^ np to degree 3 must also be retained along with the highly 
significant Location effect and the linear Age x Location interaction. Tlie 
latter confirms the reality 'jf a difference in growth rate between the Berkeley 
and North SJope populations durin;; the lonf period of essentially linear-in-age 
preadoiescenc growth in stature. From the fact that the Location contrast is 
' North Slope minus Berkeley (-\-B) , and the linear Age x Location contrast is 
negative, we deduce that the Berkeley population is growing faster. Tliis is 
confirmed b> tb- plot in I'igure 1, of the fitted group means calculated from 
the orthogonal e-^nn^atos m Table S. Between 8 and 14 years of age, the rate 
of growth of the Berkeley children is about .8 cm/year greater 



insert Table S- about here 



than that of the :.ohii "^lo^^' children. This^f igui'c is obtained by dividing the 
r.T.«-ho.Tomi n^ti-^'.r^ r.v th" nfu"> 'H i ' ^ " ro*^ f f i c i pn t fur the linear orthogorcil 
pol/noinial 'of order 0: 



1 s r 



TABLE 5 

Orthogonal Estimates: Riink 10 Polynomial ?/odel 



Effect 



Estimate 



s.n. 



Constant 

Linear Age 

Quadratic Age 

Cubic Age 

Sex (Boys-Girls) 
Location (NS-B) 
Lin. Age x ^ex 
Quad. Age x Sex 
Cubic Age x Sex 
Lin. A^^e x Loc. 



137.3027 


.1968 


42.5591 


.6145 


-0.2143 


.4805 


-0.0620 


.4782 


0.0096 


.3176 


-7.95S0 


. 3937 


-0.6483 


.9625 


1 .1S24 


.9603 


2.9.67 


.9567 


-6.3038 


1.229> 
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-6, 3038/760 = -0.,8138' 



(Se|;MSNIBRX Appendix B.) ^ 
■^*:VV • J^' ' ANALYSIS OF LONGITUDINAL DATA 



\ 0lA ^^^^y longitudinal'^^udy, e,$rf^ and every subject is measured at the 

\ ^ ^ . I- 2 

^ame or ^§quivalent, prri^sissigned time points. The formal layout of data from 

Table 6 about here' 



, V' Insert Tat 

^ .-x^ 



such a study is shovm in Table S^^fete that the measure repeated on each 
subject is indexed by the superscript ,k=l,2,...,p (in parentheses to distinguish 
it from an exponent). The- subscript, is reserved for^^the identification of 

experimental or sampling ^roup/j and for subject itdthin group j. Tne (arbi-- 

t * , . ^ . , 

trary) .number of subjects* in each group ^is N^. . Jf the groups -are further 
classified according to experimentac^ factors and/or sampling attributes, j may 
be replaced by a multiple subscript indicating the treatment or attribute 
combination. 

A. Sample Statistics .% ' j - . • ^ 

K All computations of, j lineai;; least-squares analysis of longitudinal data 
may be performed starting from*" the following summary information: 
1) "^'Tli^group vectorl^peans 

• ' \ > 



where 




^ \l ' N. * ■ 

y(k) _ l_ -J y(k) 

.1 N. . , ij 

^ J 1=1 X. 
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TABLE 6 



Form of Longitudinal Time-Structured Data 





j 




\ • 


P 








1 




(2) 

'ii 




i = 


12 N 

1 


Groups- . 


2 


^i2 


^12 ' 




i = 


1 *2 N 




n 




^in 


• ^in ' 


i = 


1,2,^..,N 
» > ' n 
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2) The subclass numbers N., j=l,2,.. .,n. 

3) . The-jpoled within-group variance-covariance matrix I in which the 
diagonal elements are the unbiased variance estimates. 



and the iff -diagonal elements are the unbiased covariance estimates 



kl- h-n 3=1 1=1 13 13 3=1 3 .3 .3 



(IV. 3) 



where N = ^E^ N\ 



A typical example of longitudinal data summarized in this form is shown in 
Table 8. The upper section of Table 8 contains the mean yearly measures of 
stature (cm.) for boys and girls ages 2 through 8 in the Berkeley study, as 
published by Tuddenham and Snyder (1954). The lower section contains the 
unbiased estimate of the common within-sex-group variation and covariation. 
Note that to facilitate visual inspection, the latter is shown in the form of 
standard deviations and correlations rather than variances and covariances. 



B. The Polynomial Model for Longitudinal Data 

A general linear model suitable for repeated measures data was first given 
by Roy (1957, p. 85) and applied to the analysis of change in Bock (1963) and 
to the analysis of growth curves by IChatri (1966), Pottoff and Roy (1964), and 
numerous subsequent workers (Kleinbaum, 1973; Lee, 1974; HSMBR, Sec. 7.2; Timm, 
1975, Sec. 5.16; Tubbs, Lewis and Duran, 1975). For present purposes, it 
is most convenient to express this model in terms of the nxp matrix Y. of 
vector means for the experimental or sampling groups: 

180 
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Y. = ASX' + ? «y. 4) 

In (12) , the n x m design matrix A contains 1 and 0 elements specifying 
how the trend effects enter additively into the expected values of the group 
means. 

The columns of the m x s matrix 3 pertain to the unknom coefficients of 
the degree s-1 polynomial model and the rows.-^ertain to main class and possible 
interactive effects of the experimental factors or sampling attributes. 

The p X s matrix X contains the leading s$p columns of the order-p Vander- 
monde matrix shown in (111.3) .. 

Row j of the ysi X -p matrix C • contains the means of errors due to random 
sampling of subjects within group j. The expected value of 5 is the n" x p null 
matrix. Different rows of C- are statistically independent, but elements 
within rows are in general correlated and their covariance matrix is 
- E, where Z is the covariance matrix of the p-variate vector observations. 

Although X is of full column rank when the are distinct (see Sec. 
III.B), A is in general not of full colaim rank. When A is of deficient column 
rank r<m, |A'DA| = 0 and, in consequence, the elements of B are not all estimable. 
Nevertheless, the normal equations arising from routine application of least- 
squares to (IV. 4) are consistent, and the various mathematical methods of 

expressing their solution (such as placing independent restrictions on th^rows 

of B) can be shown to be equivalent to decomposing the model, matrix into 

A = KL , (IV. 5) " 

where the n x r matrix K is a rank r column basis for A, and the r x m matrix 
L, also of rank r, contains the coefficients of certain selected linear parametric 
functions of the rows of B. (Bock, 1965; MSMBR, Sec. 5.1.) O^en L is specified, 
K is obtained by K = AL' (LL')'^] 

Substituting (IV. 5) in (rv.4), and at the same time introducing the 
orthoi'onal reinirametovl:ntion of the polynomials as in Section II, we may write 
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(IV. 4) as 



Y. = K(L8S)P' + 5. 
nxr rxs sxp 



Then the weighted least-squares (Gauss -Markov) estimator of r is (Lee, 

1974) 

f = (K'DK)"^ k'DY.Z"^P(P'z"^P)""^ . yV.7) 

The expected value of this estimator is r and its sampling variance- 
covariance matrix is given by the Kronecker product (see MSMBR, p. 212), 

(K'DK)-^ X (P'E-^P)"^ . (IV. 8) 

* « 

We notice, however, that (IV. 7) contains the error variance-covariance 
matrix I and cannot be applied in general unless Z is known*. Fortunately, 
there are a number of straightforward methods of dealing with this problem: 

i) Timm (1975, Sec. 5.16) has pointed out that if the degree of the 
polynomial model is set equal to p-1, then P is non-singular. P""^ = P», and the 
matrix E'""'' cancels out of (IV. 7); i.e., 

2:"*"^P(P'Z""^P)""^ = Z'^PP'EP = P . 
Thus, if p is not large and there is no advantage in using a less than p-1 
degree trend polynomial, the Gauss-Markov estimator of the orthogonal coefficient 
is obtained in an unweight4id analysis simply by transforming the vector obser- 
vations by the p X p matrix of Fisher -Tshebycheff orthogonal polynomials P'. 
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2) If the structure of Z is such that 

• - A = P'EP - IV .-9- 

is a diagonal matrix, the weight matrix cancels out of (IV. 7) for all values of 
s$p. This; is true because, if P is an orthogonal matrix and (IV. 9) is diagonal, 
the columns of P are the characteristic vectors of E and corresponding elements 
of A are the characteristic values associated with each. Thus, ZP = PA, Z = 
PAP • and Z""^ = P'A'^^P. . Then if the n x s matrix P^ contains the leading s 
columns of P, and the s x s diagonal matrix As contains the corresponding 
characteristic values, we have 

r^PjCP'Z-^pp"^ = PjAj-^CAj^b"^ = Pj, 

and the unweighted estimator is Gauss-Markov. 

This result is of considerable practical interest because it can be shown 
under mixed-model assumptions (Bock, 1960, 1963; MSMBR, Sec. 7.1.2) that Z belongs 
to a class of covariance structures diagonalized by a class of orthogonal 
transformations of * which P is a member. The former is the class of so-called 
"reducible" covariance s tinctures studied by Bargmann (1957; see also Huynh and 
Feldt, 1970)*.'^ Thus, unweighted multivariate analysis of repeated measures 
given in Bock (1963) and MSMBR (Chapter 7) is justiT^ed when applied under 
mixed-model assumptions, or more generally when P'EP can be assumed diagonal, 
even when s is less. than p. 

This result also suggests that, in the presence of non-zero association in 
P'ZP, the transformed covariance matrix may be so greatly dominated by its diagonal 
. elements that the unweighted estimates will differ but little from the weighted 
estimates. 
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The analysis in Example 2 is an instance in which this is the case. 

3) Finally, if P'Z^-is not diagonal, the most practical alternative would 
seem to.be to forego an exact analysis and proceed by maximum likelihood esti- 
mation, under large-sample assumptions. It can be sho\m (Khatri, 1966; Tubbs, 
Lewis S Duran, 1975) that, if a maximum likelihood estimator of I is available 
independent of Y. (e.g., the within-groups covariance matrix E), then, for ^ 

f = (K'DK^'^K'DY.E'-^PCP'E'^P)'-^ . (IV-10) 
is a consistent estimator of T with large-sample variance-covariance matrix 
given by the Kronecker product 

Associated with (IV. 10) is a multivariate analysis of variance that plays 

the same role in longitudinal data as does the univariate analysis of variance 

of cross-sectional data in Section III B. For purposes of the multivariate 

analysis of variance, the columns may be orthogonalized from left to right with 

respect to D to obtain, say, K*, where K*.'DK* -- I^. Similarly, the columns of 

"-1 

P are orthogonalized from left to right with respect to E to obtain, Say 

^ ^ "1 

' P*, Vh^re P*'Z"-^P* = I . Then, letting M* = K*'D and Q* = E" P* , 
1 ' X Is 



rxs 



u- 1. (IV. 12) 

-1 



[_-r-l_ 

is a maximum likelihood estimator of orthogonal parameters, T* , with large-sample 

covariance matrix I xl . The partition of the s x s matrix of sum of squares 

r s 

and. cross-products (briefly "sums of products") for the multivariate analysis 
of variance niay therefore be computed as shown in Table 7. 
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Insert Table 7 about here 

The sums of products matrices are employed in tests of multivariate hy- 
potheses of trend a.s follows: 

Suppose it is desired to test. the hypothesis that orthogonal polynomial 

coefficients greater than degree s^-l are null for some between-group effect 

c+n^ 

represented by the sum of products SSH =j^.^^5 SSB^^ on n^^ degrees of 

freedom. For this test, an error sum of products independent of SSH is extracted 

from the table. For example, 

SSE* = SSE + SSW y 
on n^ = (N-r)^ s-s^ degrees of freedom. 

Then, for s^ = s-s^, th^^ S2 x submatrices SSH2 and SSE* are extracted 
from the lower-right comers of SSH and SSE*, respectively, and the min i\>^2^ 
zero roots of the determinantal equation 

ISSH2 - XSSE*| = 0 

are found and ordered from largest to smallest. From these roots, the following 
test statistics may be computed: . ; 

1) Roy's clargest-root statistic, for example, in the form of the generalized 
F with arguments r and t (MSMBR, Sec. 3.4.7): 



where X = max X , ^=1 ,2, . . . ,min (n^, s^) 



t = - S2 + 1 



Critical points for F may be read from the table for min (11^^,52) roots in 



o 

Appendix A of MSMBR. 



TABLE 7 



Longitudinal Data: Multivariate Analysis of Variance of 
an s-1 Degree Polynomial Model for r Group Effects. 
The Sums of Squares and Cross-products are Computed 
from the Orthogonal Estimates U = 



Source of 
Dispersion 


Degrees of 


bums Or oCjuaxes 
and Cross-products 

} 


General mean 

r 


1 


t 

SSM = u u 




1 


SSB, = u,u' 
1 —1-^ 


leading effects elim- 


1 


SSB^ = u^u; 


inated and following 






effects ignored 


1 


SSB. , = u 1 
r-1 -r-1— r-1 


Between-group effects 


r-1 


SSB 


Betweea-group 
residual 


n-r 


SSE = SSG - SSB - SSM 


Group means 
Within Groups 


n 

N-n 


n 

SSG = Q[2: N y. y ] q' 
j=l J J J 

SSW = SST - SSG =, I 

' s 


Total 


n 


n Nj 

SST = Q[J: y- y^^y\^\ Q 
j=l 1=1"^-' 
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2) Hotelling trace statistic: 



2 minCn ,s ) 
T - n S X 
o " e £=1 £ (IV. 14) 



An F approximation for thisi statistic has been given by McKeon (1974): 

P (K,p)_ mP 2 

M " s_n. (D-2)n o 
^ n e 



where m = n -s^ -1 
e 2 

n 'a ~ K+2 
°= ^ ^ FT 

(m+s_) (m+n. ) 
B = ^ ^ 



(m-2) (m+1) 

2 



2 

Exact .05 and .01 points for are available in Pillai (1960) and Pillai and 
Jayachandran (1970). 

3) The likelihood ratio statistic: 

inin(nj^,s,) ^ 
" "£=1 " mr .(IV. 15) . 

Rao's F approxiTiation "(see MSMBR, Sec. 3.4.9) may be used to compute 
probability levels for A. ■ 

Note that, sines the weighted analysis is based on an estimated Z and 
assumes large-sample statistics, critical points of the distribution of X^/n^s^ 
on n,^S2 degrees of freedom (given, for" exam^le^by Haldf 1952) could be used in 
place of F^, Fj^j, or F^. . X 

Both the weighted^nd^^he unweighted. analyses include urUVariate F statistics 
for the separate- terms"^f the po■l;nomial^ If tirr<:o:;4kxon oLains that P'EP is 
diagonal; these F statistics are statistically independent ui^fe^ 
normality. Thus, a union-intersection test, namely, that the'.hy^ofd^is is 
'Vuvt.M if du-l^ siv,nruMut-.a the loXol I. . huuc suf i:^f>Y;5f6ry 
M\thU.\U;Mo \r-M \v\vl\ uMut ^\>:u\j \^unco lovol 



(c.f., Roy and Bargmann, 1958; J. Roy, 1958). > 

In the weighted case, where the terms are orthogonal i zed in the sample, 
(IV* 16) applies in large samples. Because of the greater diagnostic and de- 
scriptive detail in the F's for the separate functions, the union- intersect ion 
test is in general more useful in repeated measures analysis than are statistics 
1, 2 and 3 above. This is the test used in Example 2 in this section. 

When the rank r of the model for the sampling or experimental effects and 
the rank s of the polynomial trend model have been chosen, possibly with the 
aid of the foregoing tests, estimates of the parameters in (IV. 6) are obtained 
from {IV. 12) as follows: 

r s 

where S is the leading r rows and columns of the Cholesky factor of K^DK, and 
r 

''"-I 

T is the s leading lows and columns of the Cholesky factor of P»S P (see 
s 

MSMBR, Sec. 2.7.2). These factors are given by the ORTHM subroutine of MATCAL 

(Brock and Repp, 1974) during the orthonormalization of K with respect to D and 
"-1 

P with respect to Z 

The fitted values of the group means may then be computed from 

Y = K r P- . (IV. 18) 

' rxe 

ITie variance-covariance matrix of the element«^of (IV. 18), rolled-out 



across rows, is 

(K x P)[(K»DK)"''^ X (P'Z"'^P)"'^)(K X P)'= K(K'DK)""'^K» x P(P' K'-^P)"-^?' (IV. 19) 
The 2 Sigma tolerance interval on a new observation in group j at time point k 
is, therefore, 



Y.^*^^ ±2/1+ [K]\ (K'DK)"'^[K].. [P], (P»i:"^P)"^[P]K (IV. 20) 

3 3 3 *^ K ^ 

where [K] is the j-th row of K, written as a column, and [P], is the k-th row 

3 , . K 

of P, similarly v/ritten. 
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C. EXAMPLE 2: Longitudinal Cooparison of Growth in Stature of Boys 

and Girls Aged 2 Through 8^ 

Although sex differences in preadolescent stature are only weakly detected 

by the cross-sectional analysis in Example 1, they are clearly revealed in the 

present example when the inherently more powerful repeated measures analysis is 

brought to bear on longitudinal data* Table 8 summarizes measures of stature 

of boys and girls aged 2 through 8 from the Berkeley Guidance Study as reported 



Insert Table 8 about here 

by Tuddenham and Snyder (1954). Table 8, which includes standard deviations 
and product-moment correlations in addition to means and sample sizes, contains 
all of the information needed for a multivariate analysis of variance of mean 
trend in the two sex groups. 

The first step in examining these data is to test their conformity to the 
assumptions of the mixed model, unweighted, or weighted analysis. With the aid 
of the MULTIVARIANCE program, the common within-group covariance matrix is 
reconstructed from the standard deviations and correlations, and is transformed 
by the order 8 matrix of orthogonal pol>'nomials in normalized form. (The 
MULTIVARIANCE program gives the user the option of such a transformation and 
generates the required matrix.) The result of this transformation is shown in 
Table 9. 



Insert Table 9 about here 
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TABLO. 8 

Sample Statistics for Stature of 129 Complete Cases Aged 2 Tlirough 8 
from the Berkeley Guidance Study 



✓ 










4 


V 






2 




4 


5 


> 

6 


7 


8 


Group N 
Boys 65 


0 0 17/1 


/ 

, t/u • 0 / 


104 118 

X • X X o 


110 962 

• / 


117.335 


123.852 


129.932 


Girls 64 


87. i^^ 


etc /tQQ 


1 n h 7 ? 


110 430 


117.541 


123.639 


129.367 


fit* .a. 1 • - - - - ^\ 

With in -group S^D^ 


T 1 07C 






4. 1688 


4.5479 


4.8241 


5.1267 


2 


1 

1 . 0000 


i 












3 


■ .8706 


1.0000 


s 








■ 




.8243 


.9352 


1.0000 










Correlations 5 


.8050 


.9214 


.9603 


1.0000 








6 


.7821 


.8904 


.9187 


.9701 


1.0000 






7 


.7755 


.8941 


.9107 


.9621 


.9856 


1.0000 




8 


.7583 


.8790 




Q474 


9723 


.9889 


1.0000 


^ These are the same 


cases studied by Thissen, e£ al. 


(1976) 












\ 
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TABLE 9 

Orthogonal Polynomial Transformation of Statistics in Table 8 



Constant 



Term 

L inear Quadrat i c Cubic 



Quart! c Quint ic 



Sextic 



Group 


N 
















Boys 


65 


291.392 


36.481 


-1 ,9287 


n CI *7C 
U . 51 /b 


-U . lloo 


-f) 1 

— U . lOQQ 


-0 0626 


Girls 


64 


289.771 


37.324 


-2.3025 


-U. 1551 


-u . iiyyo 




n 076? 


Kithin -GrouD 


S.D. 


10.5552 


2.9507 


1.2480 


1.0299 


0.7507 


0.6770 


0.5814 




Const . 


1.0000 
















Lin. 


.6737 


1. 0000 . 








• 






tjuad. 


-.1934 


-.2896 


l-.OOOO 










Correla- 


Cubic 


-.0031 


-.0714 


-.3716 


1.0000 








tions * 




















Quart . 


-.0169 


-.0732 


-.1141 


-.2413 


1.0000 








Quin. 


.0658 


.2170 


.0790 


-.3062 


-.4563 


1.0000 






Sext. 


-.0511 


-.0090 


.0208 


-.0041 


.1888 


-.2531 


1.0000 



Characteristic roots of the wi thin-group correlation matrix: 

[X ] = [1.8899, 1.6498, 1.5464, 0.8845, 0.6907, 0.2911, 0.2475]. 
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Inspecting the transformed correlations in Table 9, we see that the values 
in the first subdiagonal are large enough to suggest that the population matrix 
is not diagonal. We confirm this impression by calculating, from the character- 
istic roots of the correlation matrix sho\m in the footnote of Table 9, the 
likelihood ratio chi-square statistic for testing the hypothesis of no association 
in a p X p correlation matrix (Anderson, 1958, Chapter 9): 

XpCp-l)/2 = - CN-n InX^ (IV, 21) 

^ . = 209,10 I 

On the null hypothesis and multivariate normal distribution of the within- 
group residuals, this statistic is distributed in large samples as a central 
~ chi-square variate on pCp-l)/2 degrees of freedom. In this instance^ the 
, number of degrees of freedom is 21 and the value of the chi-square clearly 
contradicts the hypothesis that the correlation matrix (and thus the covariance 

matrix)' is diagonal. We therefore conclude that a weighted analysis is necessary. 

\ 

Had we 2^ccepted the hypothesis that the population covariance matrix is 

diagonal, we would have tested the v.^riances of the linear througli sextic terms 

' \ ' 

for homogeneity. [The Hartley variance-range test is suitable for this purpose 

. - f 

. (Pearson and Hartley, 1966, ^. 202).] If these variances had appeared homogeneous, 

.we could have then pooled them to obtain for the R ratios a denominator with 6 

- x_127 = 762 degrees of freedom. Because, of the resulting increase in power of 

the F tests, this *'mixed-model" form of analysis is obviously the preferred 

approach t6 repeated measures data when it is justified (see Bock, 1963; Huynh 

5 Feldt, 1970). . . ^ 

If the population covariance matrix is assumed diagonal but the variances 

in multiple-degree of freedom subspaces of the within-subject variation are not 

assumed homogeneous, .the unweighted repeated measures analysis is indicated. 

This type of analysis is simply a multivariate analysis of variance of the 
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orthogonal polynomial transform of the original data* In the MULTIVARIANCE 
program, it is performed by transforming the summary statistics before entering 
the estimation of tests-of-hypothesis phases of the program. The estimation 

phase computes the basis matrix K in (IV* 6) and estimates effects associated 

I 

with the experimental or ^ampling structure of the data. In the present study, 

! 

the "Sampling. structure consists simply of the classification of the subjects as 

1 

male and female. Since there are only two sample groups, the K matrix generated 
by the program is 



1 -h 



The first column of corresponds to the one degree of. freedom for the 
general mean, ignorihg the sex classification, and the second column corresponds 
to the one degree of freedom between groups. Associated with each of these 
degrees of freedom is an F statistic for each of the terms in the polynomial; 

S.I " ^ ♦ 

these statistics are independent if .the transformed covariance matrix P'ZP is 

! ! - -.^ 

diagonal'. ■ ' ' \ 

i ' . 

IV^en the tran? formed | covariance matrix is not diagonal and the weighted 
analysis is required, aa additional step must be interposed between the calcu- 
latiofi. of the summary statistics and the multivariate analysis of variance: 
the matrix of orthogonal polynomials must be orthogonalized again^with respect 
to the inverse sample covariance matrix. The MATCAL subroutine ORTH^l performs 
this .operation (Bock 5 Repp, 1974). For the present data, this inverse is 
shown in Table 10. The polyxiomials orthogonalized with respect to this matrix 
are shown in Table 11. The (upper triangular) matrix of the transformation of 
thp order 7 orthogonal polynomials (i.e., the T^^ matrix of formula IV. 17) is 



Insert Tables 10 5 11 about here 
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TABLE 10 

Inverse of the Sample Within-group Covariance Matrix 



2 3 4*5 6 7 



1 . .4154 (Symmetric) 



2 


-.3141 


1.0020 










3 


-.0570 


-.4520 


1.2923 








4 


.0564 ■ 


-.0905 


-.0244 


2.1499 






5 


-.0989 


.2362 


.0192 


-.8347 


2.2599 




6 


.0127 


-.4584 


.6559 


-.6421 


-.6296 


. 4.2315 


7 


.0579 


.152Z . 


-.4108 


.3753 


. .1045 


-2.2124 



I 



< » 
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TABLE 11 

Orthogonal Polynomials for Weighted Trend Analysis 



Age 


\ 

Constant 


Linear 


T e r m § 
i^UourciLic 








Sextic 


2 


2.9204 


1.0426 


.3385 


-.5765 


.2984 


-.0876 


-.0211 


3 


• 


1.5517 


-.4531 


.4506 


-.5169 


.3225 


-.3853 


4 




2.0609 


-1.0041 


.6411 


-.0364 


-.4368 


.2625 


I' 
5 




2.5700 


-1.3146 


.3519 


. 45bo 






6 




3.0791 


■ -1.3844 ■ 


-.0601 

« 


.3468 


.7924 


.0688 


7 




3.5883 


-1.2137 * 


■ -.2379 


-.1057 


.5130 


-.2525 


8 




4.0974 


-.8024 


.1754 


.0268 


.5308 


-.0921 - 
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given in Table 12. Tables 10 and 11 contain the matrices required for the 
computation 

Insert Table 12 about here 

of the transformation matrix for the weighted analysis as given by Q* = Z'^P*. 
Since the MULTIVARIANCE program has a provision for any arbitrary linear trans- 
formation of the sample data, it is a simple matter to perform the weighted 
analysis with the tl-ansformation matrix Q*, 

For purposes of comparison, the results of both the weighted and unweighted 
repeated measures trend analysis are shown in Table 13* Despite the apparent 
smooth progression of sample means sho\m in Table 8^ the differences between 

Insert Table 13 about here 



the sex groups is not a simple function of age. Both the weighted and unweighted 

ft 

analysis show a significant degree 5 trend component in the differences between 
the means of the sex groups. To represent completely systematic differences in 
average stature of boys and girls in this age rang^ therefore requires a rank 2 
model for sample classes (r=2) and a rank 6 model for trend (s=6) . 

If the subjects regarded as a sample from a single pcpulation^and the sex 
groups are combined, the curve of mean growth is considerably simpler. ^Bc/th 
analyses show at most a marginally significant cubic component, * Ignoring the 
sex classification thus leads to a rank 1 (r=l) model for the sample and a rank 
4 (s=4) mociel for trend. 

The weighted and unweigKted estimates of the orthogonal polynomial coef- 
ficients for these models are shown in Table 14. Note that when the quintic 
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TABLE 12 

Coefficient Transformsktion From Unweighted to 
Weighted Orthogonal Polynomials 



Unwei ghted 

"1 2 3 \ 4.^ - • 5 ■ 6 7 





1 


7.7266 


6.7996 


-2.2050 . 


* 

. 0.2813 * 


0a697 ■ 


. 0.6322 


-.3285., 






* 


2.6941 . 


• -1.0062' 


, 0.0336 


0.0739 


■ 0.6549 . ^ 


-.0267 




3 


1 




1.1025 . 


-.5^26 


•-.1144 . 


.1086 


.0260 


Weighted 


4 


t 




■ 


.8742 


-.4352 


-.3271 


-.0042 




S 


* 




) 




".6.656 


-.3170 


.1417 

• 




6 










.6550 


-.1714- 




7 


(Triangular) 












-.5814 
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TABLE 13 



Test Statistic for Longitudinal Trend Analysis 
of Growth.in Stature of Children Aged 2 
Through 8 in the Berkeley Guidance Study 
. (Within-groups^ df=127) 



Source of ^ 
Variation 



d.f. 



Weighted 



Unweighted 



General Mean 

Constant 
Linear 
Quadratic 
Cub i c 
Qii.'irt i c 
Quint ic 
Scxtic 



84,805 
21,770 
443.0 ■ 
.1.S76 
2.420 
0.4969' 
.0150 



<.0001 
<.0001 
<.0001 
.061i 
.122 
.482 
.903 



97,770 
20,172 
370.2 
4.154 
2.729 
.4223 
.0150 



<.000i 
<.0001 

<.oobi 

.043 
.101 
.517 
.903 



Between Sexes 

Constant 

Linear 

Quadratic 

Cubic 

Quart ic 

Quintic 

Sextic 



4,210 

.0867 
11.040 

5.388 

2.264 ^ 
11.692 

1.836 



.042 
.769 
.001 

.022 2, 
.135 " 
.001 
.178 



.762 
2.631 
2;893 
13.672 

.0213 
8.792 
1.836 



.385 
.107 
.091 
.004 
.884 
.004 
.1'78 
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Ini^ert Table 14 about here 

polynomial is assumed, the weighted and unweighted solutions give essentially 
the same result. This is a consequence of the very small correlations between 

V r 

the sixth degree teim and the renpaining terms of the polynomial (Table 9). With 
respect to the last term, the transformed error covariance matrix is nearly 
diagonal, and the weighted and unweighted analysis become nearly identical at 
the f if til degrea term. 

IVhen the cubic polynomial is assumed, on the other hand, the effects of 
the weights are more evident, especially in the sex effect and sex x age inter- 
actions, which are sensitive to the greater weight assigned at younger ages 
where the within-sex variation is smaller. Despite the significant failure of 
fit of the degree-3 model, the fitted means reproduce the observed means almost 
as well as the much less parsimonious degree-5 model. This is apparent in 
Table 5, where the observed means in Table 8 are reproduced along with means 
computed by (IV. 18) from the weighted estimates in Table 14. The figures in 
Table 15 demonstrate the efficacy of low-degree polynomial models for .growth 
when a limited ag-^ span is examined. 



Insert Table 15 about here 



V. SUMMARY 

A methodological problem widely encountered in the study of secular trend, 
growth and development, or experimental manipulation of behavior is that of 
detecting and describing systematic change over time. With certain restrictions 
on the design of the study and the method of measurement, this problem has a 
ready solution in analysis of variance and its multivariate extensions. To be 



TABLE 14 

Longitudinal Trend Analysis f Estimated 
Orthogonal Polynomial Coefficients' 



Cfrect 


ucgree o 


Weiglitcd 




Unweighted 


General Mean 










Constant 


290.5870 




290.5694 


290.5816 


Linear 


36.9030 




36.8709 


36.9026 


Quadratic 


-z . iioO 








Cubic 


U • LOCO 






1827 


Quartic 


(\ 11 no 

-u# iiuy 




V 


1 noi 


Quintic 


U • yjHcc, 






n4ni 


OCX 






1 9692 


1.6220 


Age X Sex 










Linear 


-0.8492 




-0.4353 


-0.8429 


Quadratic 


0.3800 




.4151 


.3738 


Cubic 


076696 




.3573 


- .6706 


Quartic 


0.0145 






-.0193 


Quintic 


-0.3944 






-.3535 
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TABLE ^ 15 

e 

Observed and Fitted Age-group Means for the 
Berkeley Guidance Study. Data 



Observed 



Boys 



Girls 



Mean Stature (cm.) 
Degree 5 



Fitted' 



Boys 



Girls 



Degree 3 



Boys 



Girls 



Age (yrsO 
2 
3 
4 
5 

6 " 

7 ' 
8 



'88.17 
■ 96.58 
104.12 
110.96 
117.34 
123.85 
129.93 



87.12 
95.49 
103.07 
110.43 
117.54 
123.64 
129.37 



88.17 
96.54 
104.15 
110.91 
117.34 
123.83 
129.92 



87.13 
95.54 
103.04 
110.49 
117.53 
123; 67' 
129.38 



88.23 
96.48 
104.03 
111.04 
117.62 
123.92 
130.06 



87.16' 

95.42 
103.20 
110.48 
117.24 . 
123.48 
129.18 



^ From the weighted estimates 



* amenable to this technique, the observations shoufd be time-structured (i.e., 
limited to a moderate number of pre-assigned time points, pr'eferably equally 
spaced), and the measurement of the trait or response in question should be 
made on a sc^ale with commensurate units throughout the relevant range. The 
analysis is further facilitated if, in cro^s-sectional data, the observations 
"^are replicated at each time point, or, in longitudinal, data, all subjects are 
observed at precisely the same or comparable time points. 

IVhen the data are cross-sectional Ci-©., independent samples of subjects 
> are* drawn contemporaneously at the several time points), the shape of the curve 
describing time-dependency of the population mean, and differences in the shape 
between populations, can be investigated in a polynomial trend analysis. A 
\ single-degree-of-freedom univariate analysis of variance of successive orthogonal 
polynomial components of trend and trend differences provides a convenient, 
exact, unbiased minimum-variance method of performing this analysis. Although 
the calculations for this analysis are most straightforward when the time- 
points are equally spaced and the equal numbers of subjects are sampled at each 
time point, the statistical theory and computer methods for unequal spacing and 
unbalanced sampling are fully worked out and available if needed. 

IVhen the data are longitudinal (i.e., each subject is measured at each 
time point), trend analysis of the population time-point means, or differences 
in trend between populations, can be carried out by multivariate repeated 
measures analysis or, in favorable cases, by mixed-model univariate analysis of 
variance. If the variance-covariance structure of the sampling errors is trans- 
formed to no-association (i.e., uncorrelated) by a suitable orthogonal matrix 
independent of the data (e.g., a matrix of Fisher-Tchebycheff orthogonal poly- 
nomials), an exact analysis of trend is provided by a multivariate analysis of 
variance in which the orthogonal com^^nents of trend appear' as variates but are 
tested in a manner analogous to, but in general more powerful than, the single- 

# • 
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degree-of freedom" tests in the univariate analysis of variance of cross - 
sectional data. If the transformed errors are uncorrelated and the error trend 
components exclusive of the constant component are homogeneous in variance, a 
pooled estimate of the error components may be used and the multivariate repeated 
measures analysis specializes to a still more powerful single-degrefc-of-freedom 
mixed model univariate analysis of variance. 

If the error covariance structure cannot be reduced to no association by a 
suitable orthogonal matrix independent of the data, a consistent, efficient, 
large-sample, weighted method of repeated measures analysis based on the Pottoff- 
Roy formulation may be available. It is shown here that this analysis Is 
conveniently implemented by orthogonalizing the Fisher-Tshebycheff orthogonal 
• polynomials wit;h respect to the inverse of the sample within-group covariance 
matrix. The statistical tests of conventional multivariate analysis of variance - 
of trend components computed with this re-orthogonalized matrix weighted by the 
■inverse sample covariance matrix may then be interpreted in a large- sample || 



sense. 



Examples of these procedures applied to measures of stature and computed 
with the MULTIVARIANCE- program are presented in the text. 
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Footnotes 

1 

This sectipn is based on Section 5*2.5 of Bock, R, D. Multivariate statistical 
roethods in behavioral research . McGraw-Hill, 1975 (hereafter referred to as 

. M&MBR). - ^ 

2 .V ^ 

Various designs for semi-longitudinal studies have been proposed C^chaie, 
1965). Their analysis is beyond the scope of this paper. 

X ' - • ' 

The hypothesis that the population transformed error matrix is diagonal may be 

tested by a likelihood ratio test of no-association in the transformed sample 

matrix P'EP; (See Anderson, 1958, Chapter 9.) 
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. ABSTRACT 



This paper is concerned with"" che analysis of multivariate categorical 

# ^- 

data wl)ich are obtained from longitudinal studies of human growth and 
dev^lopraent* An expository discussion of pertinent hypotheses for s\ich 
situations is provided \ri.thin the contjsxt of two methodologically illustra-\ 
tive examples, and appropriates? test statistics are developed through the* 
application of weighted least squares. These procedures are illustrated 
with extensive analyses of " each of the data sets. 
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I. INTRODUCTION 

Many longitudinal investigations dealing \^ith behavioral and/or 

educational 'cievelopment are concerned with intraindividual change for 

variables which are measured in terns of discrete categories (based on 

nominal or ordinal as opposed t6 interval scales). Examples of such 

categorical .(qualitative) variables include measures of 

* 

(i) chi'ld competencies in task performance, 

(ii) verbalization patterns, 

(dii) coping ability in stress situations, 
' (iv) self-ccncept, V 

(v) parent-child interaction,- 

developmental stages. 
Thus, the basic research design, .for such studies involves the classifica- 
tion of each subject \iith respecj: to each categorical variable (which is 
called an attribute) at each of several successive time points. Moreover, 
the subjects may also be classified into a set of sub -populations on the 
basis of other categorical variables such as 
(vii) demographic characteristics, 

^iii) health status with respect to the presente or absence 

of certain traits,^erg. , dyslexia, 
* (ix) prog'ram status with respect to certain specialized types 

of' training. 

Within the context of this framework,^ the data resulting from longi- 
tudinal studies can be conceptually arrayed in (potentially very large) 
multidime?isional contingency tables for which the! corresponding dimensions 
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are the classifications according to each attribute like (i)-(vi) at each 
time point, together with the respective sub-population variables like 
(vii)-(ix). ' For this reason, the various questions of interest for data 
analysis may be regarded as' equivalent to statistical models for the cell 
'probabilities in such contingency tables. Thus, in principle, data 
analysis can be undertaken in terns of various computational algorithms 
for contingency table model ^fitting. As will be demonstrated in Section 
III, the weighted least squares methods discussed by Grizzle et^ al^. 
(1969), Koch et aa. (1977), and Landis et,al^. (1976) can be used to deal 
with questions pertaining to 

(a) the nature and extent of intraindividual change for the respec- 
tive attributes over time, both separately and simultaneously, 

(b) the nature and extent of interindividual differences among two 
or more sub-populations with respect to intraindividual change 
over time 'for the respective attributes, 

(c) the nature and extent of the variation over time of the relation- 
ship aiacng two or nore attributes as reflected by certain 
measures of association. 

In this regard, the basic approach is in the same spirit as multivariate 
analysis of variance (profile analysis and/or growth curve analysis) with 
respect to analogous intervally-scaled quantitative data situations. Tor 
this reason, its application to longitudinal data is the primary purpose 
of this pap'3r. The types of examples where weighted least squares methods 
are potentially most useful are briefly described in Section II. Specific 
formulations of the various hypotheses of interest are Vhen presented. in 
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Section III and their evaluation is illustrated in Section IV with respect 
to the examples in Section II. The paper concludes with a brief 'discus- 
sion o^ certain special computational considerations for dealing with 
very large contingency tables, together with other potential" difficulties 
which may arise in the analysis of longitudinal data. 

Alternatively, in many investigations, the questions of interest 
pertain to the identification of the underlying structure of a large 
number of attributes in terms of a small number of implicit dimensions, 
and hence are analogous to those for which factor analysis is used with 
quahtitative data. This topic is outside the scope of the present paper* 
However, it i3 discussed to some extent by Goodman (1974) in the context 
of latent structure analysis. Similarly, the analysis of transition 
patterns over-time for one or more attributes in terms of stochastic 
process models is also outside the scope of this paper. Further informa- • 
tion with respect to this general subject area is given in Bishop, Fien- 
berg, and Holland (1975, Chapter 7). 

II. LONGITUDINAL DATA EXAMPLES 

In this section, we present two examples which may be regarded as 
methodologically illustrative data sets from longitudinal studies in 
human growth and development. In particular, a simple one-population 
study involving two attributes measured at two time points is considered 
in Section II A td indicate the full range of hypotheses which can be 
tested. Moreover, in Section II B a two-population study involving one 
attribute measured ak three points in time is used to illustrate the 
types of hypotheses associated with comparing growth curves among several 
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groups. Although these examples involve hypothetical data and are much 
♦ smaller in scope than those usually encountered in research situations, 
.the extension to more complex designs is straightforward as developed in 
Section III.. 

V 

%vA. A Single Population Example 

The following hypothetical example arose from a longitudinal study 
in which two developmental attributes labelled Al and A2 were measured at . 
two time points labelled Tl and T2 for an age cohort of 354 children. In 
this regard, each subject. was classified as absent (1) or present (2) for 
each of the attributes at each of the specified time points. The frequency 
data corresponding to each of the 16 possible response profiles is shown 
in Table 1. , * ^ 

Irtsert Tabl^) 1 About Here / 
7"/"'- ' 

The statistical -issues concerning "intraindividual change can be 

summarised within the *f rameworU of the following basic questions. 

r'X: ; ■ s- 

(1) Are there any differences, between the occurrence rates of 
the t\sND attributes at each o£ the .time points? 

(2) Are there any dj-f^ereROps between the two.timfe points with 
respect to the set of individual occurrence rates of the two 
attributes? 

(3) Is there any attribute x time interaction in the occurrence 
rates of the two attributes? 
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Table 1 

Attribute data for^ longitudinal study 



Tl 



T2 



Al 
A2 

Al 
A2 



Response Profile for Al and A2 at Tl and T2 . 

1 1 1 1 1 1 1 1 2 2 2 2 2-2 2 2 

1 1 1 1 2 2 2 2 111 1 2 2 2 2 

1 1 2 2 1 1 2 2 1 1 2 2 1 1 2 2 

12121212 121 2121 2 



TOTAL 



FREQUENCY 



57 36 18 69 0 0 0 33 0 3 0 15 0 0 0 123 



354 
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(4) Are there any differences between the two time points with 

' , respect to the overall joint distribution ot the two attributes? 

(5) Is there any difference between the two time points with respect 
to a selected measure of association or agreement between the 
two attributes? 

The first three questions which involve the occurrence rates of the two 
attributes are essentially similar to the hypotheses of interest in 
repeated measurement (or mixed model} experiments as discussed in further 
detail in Koch and Reinfurt (1971),, Koch et^ al • (1977) and Landis and 
Koch (1977a). , More specifically, question (1) addresses .differences 
among attributes, question (2) involves the issue of time. point differences, 
and question (3) is concerned with the attribute x time interaction as 
measured by the individual occurrence rates of the attrioutes. Thus, the 
first-order (univariate) marginal distributions of response for each of 
the attributes within each time point contain the relevant information 
for dealing with these 'questions. In contrast to overall average differ- 
ences among the occurrence rates, questions (4)-(5) address the relation- 
ship between the attributes on -specific subjects across the time periods. ^ 
As a result, these question^ involve measures of association or agreement 
between the attributes such, as those discussed in Bishop, Fienberg, and 
Holland (1975) and Landis and Koch (1975a, 1975b). Hence, certain func- 
tions of the diagonal cells of various subtables are used to provide ^ 
information for dealing with these questions. 
B. A Two-Population Example 

The following hypothetical exanple arose from a longitudinal study 
to compare boys and girls from a selected age cohort with respect to 
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their ability to perform a particular behavioral task. In this regard, 
each subject was graded as success (S) or failure (F) at the end of 1 
year, 2 years, and 4 years of follow-up. These resulting data are shown 
in Table 2. 

I 

Insert Table 2 About Here 

« 

Accordingly, the statistical issues concerning these differences in 
growth patterns can be sununarized within the framework of the following 
basic questions: ' 

(1) Are there any differences between the boys and the girls with 
respect to the behavioral task success rates at the three time 
points? 

(2) Are there any differences among the three time- points with 
respect to the behavioral task success rates across the two 
groups of children? 

(3) Is there any sex group x time interaction with respect to the 
behavioral task success rates? 

Tfiese three questions involving the success rates are directly analogous 
to the hypotheses of ''no whole-plot effects," "no split-plot effects, 
and "no whole-plot x split-plot interaction" in standard split-plot 
experiments as described in Andersr>n and Bancroft (1952), Federer (1955), 
or Steel and Torrie (1960). In particular, since time is the split-plot 
factor, these resulting success rates give rise to growth profiles for 
each sex group. In this context, question (1) addresses group differ- 
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Table 2 

LONGITUDINAL DATA FOR BEHAVIORAL TASK 





Response Profile at year 1 vs 'year' 2 vs 


year 4 






Sex 


SSS SSF 


SFS 


SFF 


FSS 


FSF 


FFS 


FFF 


TOTAL 


Boys 


0 0. 


5 


0 


21 


14 


51 


71 


162 


Girls. 


16 5 


12 • 


5 


71 


12 


74 


14 
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n 




ences; question (2) involves the issue of ti-me differences, and question 
(3) is concerned with the hypothesis of parallelism among coi'responding 
segments of the growth, prof iles. Consequently, the joint set of first- 
order (univariate) marginal distributions for each of the time points 
within each sex group contain the relevant information for dealing with 
these questions. 

III. METHODOLOGY 
This section is concerned with a general methodology for answering 
the types of questions outlined in Section II in terms of specific hypo- 
theses. Because the measurement scales of the response variables (here- 
after referred to ^as attributes) are categorical, the conceptual forraula- 
tion of such hypotheses must be undertaken in terms of an underlying (s x 
r) contingency table, where s is the number of sub-populations and r is 
the number of possible multivariate response profiles. Test statistics 
for such hypotheses and the estimators for parameters of underlying 
linear regression models are obtained through weighted least squares 
computations by methods originally described in Grizzle, Starmer, and 
Koch (1969) (hereafter referenced as GSK) as reviewed in the Appendix. 
Consequently, this methodology represents a categorical data analogue to 
more well-kno\^ counterparts for quantitative data like multivariate 
analysis of variance as described by Cole and Grizzle (1966) and Morrison 

(1967) in the parametric case and multivariate^ rank analysis as described 

by Koch (1969, 1970) in the non-parametric case. 

For longitudinal studies, each subject is measured on the same set 

of d attributes at each of t time points. In accordance with the general 

framework in the Appendix, let i = l,2,.-.,s index a set of sub-populations 
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from which random samples have been selected; Let m = l,2,...,d index a 
set of d characteristics or attributes corresponding to behavioral tasks 
which are measured at each time point using an7L^-point scale. Then let 
the r = (L L^.-.L^)^ response profiles be indexed by a vector subscript 

i = (ii'i2"-"it5 ""'^ ig " ^^gr^g2'--"^gd^' ^ ^'^"--'^n. ' 

form= l,2,...,d and g = l,2,...,t. Furthermore, let Ti.. = ^ij ^, j^* ' ' ' »it 
represent the joint probability of response profile j for randomly se- 
lected subjects from the i-th sub-population. Then the first-order 

marginal probability * i = 1,2, ...,s 

g = 1,2, ... ,t 

A = E ... I TT..* . . for m = 1,2, ...,d (HI.l) 

ig^'^ j Kith jg„ = k^-:i'^2"-"^.t k = 1,2,...,L^ 

represents the probability of the k-th response category of the m-th 
attribute at the g-th time point in the i-th sub-population. 

In addition, it should be noted here that this formulation for 
longitudinal studies presumes the following conditions: 

(i) there is no assumed strucrar^. on the attributes, so that 

all possible attribute combinations or response profiles 

are observable, i.e., tt^^ > 0 for all j and for i=l,2,...,s; 

t 

(ii) every subject entering the study is followed until com- 
pletion of the study, i.e., there are no sost-to-foUow up 
cases; 

(iii) every subject is measured on each attribute at each time 
point, i.e., thei^e is no incomplete data. 

Further discussion of these potential difficulties is given in Section V 

in the form of concluding remarks. 

A. Hyp otheses Involv ing Marginal Distributions 

Hypotheses directed at questions pertaining to average differences 
among sub-populations, attributes, and time points involve the first-order 
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marginal distributions of the response profiles and can be expressed 
terms of constraints on the corresponding probabilities i^^^^gj^j^^- More 
specifically, the hypotheses associated with questions (1) - (3) of each 
of the examples in Section II can be formulated within the scope of one 
of the following statements: 

(1) If there are no. differences among the marginal distributions of 
the respective attributes at each time point for the s sub- 
populations, then the {<{>ign^i^) satisfy the hypothesis 

H^w- ^^-i 1 = ^ = <^ 1 for g = l,2,...,t 
SM ngmk ■^2gmk 'sgmk „ = i . 2. . . . ,d , (III. 2) 

^ k— 1,2,*««, L 

m « 

where SM denotes sub-populations means; 

(2) If there are no differences among the marginal distributions of 
the respective attributes over the t time points within each of 
the sub-populations, then the ^igj^k^ satisfy the hypothesis of 
composite first-order marginal homogeneity (symmetry) 

X ~~ l,2j«««,s 

H : 6. = 6. = . . . = 6. , for m = 1,2,. ..,d , (III. 3) 
n>lH ^ilmk ^i2mk ^itmk k = 1 2 L 

****** m 

where TMH denotes time marginal homogeneity; 

(3) If there is ;io time x subgroup interaction (with respect to 
the marginal distributions of the respective attributes at 
the t time points), then the {^^gj^j.} ^^Y be written in terms 
of an additive model 

i = 1,2, . . . ,s 
g = 1 ,,2 , . . . , t 

"sr *igmk " ^mk ^ ^i*mk + "^^gmk for "| I > •(III-.4) . 

n 

where ST denotes subgroup x time, and where for the m-th 

attribute, u , is 'an overali mean associated with the k-th 
mk 
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response category, Z^^^^ is au effect due to the d-th sub- 
population, and "f^gj^j. is an effect due to the g-th tirae 
point, and where it is understood that the {p , }. {r. * 
and t^^gy^} satisfy the usual analysis of variance constraints. 
Moreover, if the d attributes are all measured on the same L-point 

scale, it follows that L = L for m = l,2,...,d. For example, each 

m ^ ' ' 

attribute may be classified as present or absent as proposed in the 
example^in Section 2.1, or each attribute may represent a different scheme 
of classifying development under the assumption that there exists an identical 
number of steps or stages as discussed in Wohlwill (1973). In such situa- 
tions, several additional hypotheses of this type may become of interest: 

(4) If there are no differences among the'marginal distributions of 
the attributes at each of the time points within each of the 
sub" populations, then the t^^'^g^j^}^) satisfy the hypothesis of 
marginal homogeneity (symnietry) among the attributes 

"a:-IH* ^iglk " ^ig2k " ^ignk for g = i;2;!!!;t , (III. 5) 

k — 1,2,. •.,L 

where A^Q-I denotes attribute marginal homogeneity; 

(5) If there is no interaction between the marginal distributions 

of the attributes and time within each sub-population, then 

the t^^g^^^^ be written in terms of an additive model 

i = l,2,'...,s 

"H:6^ =U +£ +T g=l,2,...,t 

AT ^ifemk Ik "-ig^k ^i*r.k m=l,2,...,d, (III. 6) ^ 

k = 1,2, ...,L 

where AT denotes attribute x time, and where for the i-th 

<u'»-lv;Milat ion. u . ^ is an ovcrnll mean associated with the 
\l 

I xh rt*»non.»e cateiiorv, t' Is an effect due to the g-th 

time noint, and r... , is an effect due to the m-th attri- 

butc,, and where it is understood that the {p-, }, (5. ^, ), 
/ ^ ik ig*k 

\ • 220 



ERIC- ^ . 241 



md (t } satisfy the usual analysis of variance constraints. 
^ i*mk 

All of these considerations can be extended somewhat further if 

^^^^-.nfi /^<t V- - 1 *> L for m = 1.2, ,d are ordinally 

the respopsc categories k - i,-, — .t-jj, ^^t- 

scaled \^ith progressively larger intensities". In this situation, the 

effects or the respective sub-populations, attributes, and time points 

can be compared in terms of summary indexes 

^ni i=l,2,...,s 
\gn " ^^^''nk^igm.k for g = lW.'.'.'.',t . (III. 7) 

n=l,2,...,d 

Here r can be regarded as a mean score for the m-th attribute at the 

'ign 5 . 

g-th time period in the i-th sub-population with respect to an under- 
lying numerical scaling .a^,' ' ' ' ' ""^^ ^n-. 

In this context, the {n^g^} are equivalent to m'ean scores derived from- 
strictly quantitatively scaled response categories as discussed in 
Bhapkar (1966). Thus, the hv-potheses in (III. 2 - "I-G) can also be 
expressed in terms of constraints on the {n.g„,} in (HI. 7). .Expressions 
of these hypotheses in terms of' the {n.^^) are diSculsed in mhvo detail 
in Koch et aj^. tl'^""J and are illustrated in Landis (1975). 
B. Hypotheses involving Measures of Association 

Unereas the h)-potheses in Section III A were addressed at comparisons 
among sub-populations, time points, and attributes within the context of 
first-order marginal distributions, the h>'potheses in this section are 
directed at relationships anong the attributes at a given time point, 
and the extent to which those relationships change across time. These 
hypotheses can ba foraulated in terns of comparisons among full joint 
distributions ur second and highor-order joint marginal distributions 
across time uerioJs or in terms of neasi"-cs of association such as the 
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log cross-product ratio for nominal data as discussed in Bhapkar and Koch 
(196Sa, 196Sb) or the Goodman- Kruskal rank correlation coefficient for 
ordinal data as discussed in Forthofer and Koch (1973). 

In general, these hypotheses can be expressed as a set of constraint 
equations on the joint probabilities of specified re^onse profiles. For 
purposes of simplicity, we will focus on the joint distributions of two 
selec€ed attributes (relabelled as 1 and 2) at each of the t time points 
for each of the s sub-populations. Consequently, the joint probability 
of the kj-th category on the m^-th attribute and the k2-th category on 
the m2-th attribute at the g-th time point in the i-th sub-population can 
be written as 

Using this notation, the log. cross-product measures of association between 

« 

the two attributes can then be expressed as 



igLjk, igkjL^ j •k2= .1,2, .,1^-1 

In particular, foi; two dichotombus Uttr^Lbutos (L^=L>2) , the measures of 

association {A-„,. , > in (3.9) reduce to- the familihr Jog.;cross-product 
igk^k2 

ratio for a 2 x 2 table ^ 

V2I 



r V, « i=l,2,...,s 

h. = log 
ig e 



'^ igll '^iR22 I for g = i;2;...,t . (III. 10) 
ig21 



Otherwise, an alternative measure of association for 2x2 tables due to 

Yule can be fornulated as 

y V - y y 
Q. = 'igll 'ig22 iR21 for i = 1,2, ...,s 

— ^ ' ^ g = 1,2 t . (III. 11) 

V u + w y bill 

^igirig22 ^ig2rigi2 
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(For' a more complete discussion of measures of association, see Bishop, , 
Fienberg, and Holland, 19^5, Chapter 11.) 

Hypotheses concerning compariso.ns among full joint distributions. of 
the. attributes can now be expressed in terms of constraints on the joint 
probabilities {H*. . . . ) . More specifically, hypotheses associated with 

lgKj^K2 

^, questions such as (4) in Section II A can be formulated within the scope - 
^of^one of the following statements; 

' ' (&) If there are no differences among the joint distributions of 
the two ^attributes ^nong the sub-populations, ' then the 

, , } satisfy the hypothesis 
" 1 2- \ g = 1,2, ...,t 

H •■ -i- ' = V , , = ... V ^ , for k = 1,2, ..,,L (III. 12) 
"SJD- 'igk^k^- 2gk^k2 sgk^k, = 1>2,^:.,l1 

whe-re SJD denotes sub-population joint distributions; 
(7) If there are no differences among the joint distributions- 

of the two attributes among the tiuTe points, then tlie _ . _ 
{4/ } satisfy the hypothesis 

• ^"^'^2 . i = i,2,...,s- 

H • v , \ = , = ... = Y-^, i- for '^i = 1.2,,..,L, (in. 13) 

V- "^ilk^k^ ^2k,k., itk^k^ = i,2,...,L^ 

where TJD denotes time joint distributions. 
Additional hypotheses involving the joint distribution probabilities 
in (II I. S}', sucii as an additive .-odcl Implying no interaction between sub-_ 
populations and time periods directly analogous to (111.4), could also be 
considered here. Moreover, hypotheses of "no interaction" among higher- 
order joint distributions involving more than two attributes simultah- 
eously can b& developed as direct extensions of these results, although 
the notation for corresponding expressions becomes more cumbersome. 
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Similar considerations also apply to hypotheses of **no interaction" for 
the joint distribution over time of each separate attribute and/or simultan- 
eous sets of attributes. Finally, a log-linear model can be fitted to 
the joint distribution of the attributes at each time point under appro- 

I 

priate hypotheses of "no interaction" as discussed in Koch £t al_. (1976). 

This approach then permits hypcthesis testing for relationships across 

the time points in terras of the resulting log-linear model parameters. 

Alternatively, several hypotheses associated with questions such as 

(5) in Section (II. A) involving the measures of association in (III. 9) 

can be formulated as follows: 

^ (8) If the two selected attributes are independent of each other at 

each time point within each sub-population, then the {A. , , } 

satisfy the hypothesis * 

i = 1,2, ...,s 

"dt- w =0 for g = 1,2, . ..,t , (III. 14) 

^^\^2 kj= l,2,...,Lj-l 

lc2"' 1>2, . . .,L»2''l 

where PI denotes pairwise independence; 

(9) If the relationship between the two attributes as measured by 

the. log cross-product ratio is the same across the time points for 
each' sub-pupulation, then the (A. , } satisfy the hypothesis. 

i = 1, 2, . . . ,s 

"ta' ^ilkjk^ " ^i2kjk2 = = ^itk^k^ k^- i!2!...!Lj-1 ^(111.15) 

1>2,...,L2-1 

where TA denotes time association; 
(10) If the relationship between the two attributes as measured 

by the log cross-product, ratio is the same across sub-popula- 
— tions at each tii.ie point, then the {A. . , } satisfy the 
hypothesis 

** g =1,2, . ..,t 

IL.: A. . , = ,^ , = ... = A , . for k =1,2,...,L--1 , (III. 16) 
SA IgK^k^ 2gkjk2 sgk^k^ kl=l>2,...,L^-r 
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where SA denotes sub-population a':: ociation; 
(11) If there is no sub-population x time interaction with respect 

to the log cross-product ratio measure of association, then the^ 
{* } may be written in terms of an additive model 

i — 1,2, •••>s 

g = i,2,...,t , Cin.i7) 

•^2~ ■'■>>•••» 2~ 

where STA denotes sub-population x time association, and where 

u, , is an overall mean effect, C-*,. ,. is a sub-population 

effect, and . , is a tine effect, and where it is under- 

stood that the {y^ ,^ }, {q*^ ,. ) and {t^^^ ^ } satisfy the 

12 12 12 

usual analysis of variance constraints. For an application of 

this type of additive model to measures of association, see 
Grizzle and Williams (1972). 
Moreover, if the d attributes are all measured on the same L-point 
scale, hypotheses directed at the extent to which individual subjects 
are classified into the same category for each attribute can be investi- 
gated. For example, agreement on the classification of . developmental 
stages by several different criteria is of considerable importance in 
establishing certain theories of behavioral growth (see Wohlwill, 1973). 
These problems are similar to those raised in the general area concerned 
with the measurer, ent of agreement, and as such have received attention in 
a wide range of research areas as reviewed recently in Landis and Koch 

(1975a, i975b). In this regard, nicierous measures of observer agreement 
have been proposed for categorical data, e.g., Goodman and Kruskal (1954), 

Cohen (1960, 1965), Fleiss (1971), Light (1971), and Cicchetti (1972). 

Mu ,1 oi' t'nO't' mi.nUiru"^ iir o! llio torm 

. = "o - 'e (III. 18) 
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where is an observational probability of agreement and tt^ is a 
hypothetical expected probability of agreement under an appropriate 
set of baseline constraints such as total independence of attribute 
classifications. 

Furthermore, kappa-type measures of agreement directly analogous 
to (III. 18) can be developed to investigate the joint agreement of several 
attributes, as well as the pairwise agreements of two selected attri- 
butes. In addition, sets of weights which reflect the role of each 
response profile in a given agreement index can be selected to investigate 
"path" models of development among several behavioral tasks as discussed 
in Wohlwill (1973). Applications of such generalized kappa-type mea- 
sures of agreement to clinical diagnosis data involving several observers 
is discussed in Landis and Koch (1977a, 1977b). In particular, the choice 
of weights which are in a hierarchical relationship with each other can 
be used to investigate hypothesized patterns of development i^uch as syn- 
chronous progression, convergent "decalage," divergent "decalage," and 
reciprocal interaction (see Wohlwill, 1973, p. 215).. 
C. Estimation and Hypothesis Testing 

Test statistics for the h>TDotheses considered in the previous 
sections as well as estimators for corresponding model parameters can 
be obtained by using the general approach for the analysis of multi- 
variate categorical data discussed by GSK (1969). This procedure can 
be implemented by constructing the appropriate functions of the observed 
proportions which are directed at the relationships under investiga- 
tion by a sequence of n^atrix operations. Then a weighted least squares 
computational algorithm is used to generate linearized minimum modified 
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chi-square test statistics. The basic elements of the GSK procedure- 

which pertain to this paper are summarized in the Appendix. 

All the hypotheses in Section III. A involving constraints on 

the fir$t-order marginal probabilities can be tested by expressing 

the estimates of the {6. , } or the {n. ) as linear functions of the 

igmk igm 

type given in the Appendix (A. 14). Although these particular matrix 
expressions have already been discussed in considerable detail in 
Koch "and Reinfurt (1971) and t et al^. (1977) they will be presented 
within the context of the data analysis in Section 4. Otherwise, their 
specific construction for hypotheses like (III. 2) -(III. 6)' is also docu- ' 
mented in Landis (1975). 

la contrast to the linear functions which pertain to- the hypotheses 
in Section III. A, all the hypotheses involving measures of association 
and agreement require the expression of the corresponding ratio estimates 
as compounded logarithmic-exponential- linear functions of tfie observed 
proportions as formulated in the Appendix (A. 20, A. 21). As a result, the 
test statistics for the hypotheses in Section III.B can also be generated 
by the corresponding expression given in th** Appendix (A. 11). 
IV. ANALYSIS OF LONGITUDINAL DATA EXAMPLES 

This section is concerned with the analysis of the longitudinal data 
from examples II. A and II. B presented in Tables 1-and 2 with primary 
emphasis given to illustrating the methodology in Section III. In this 
regard, tests of significance are used in a descriptive context to identify 
important sources of variation as opposed to a rigorous inferential con- 
text; thus issues pertaining to multiple comparisons are ignored here. 
These, however, can be handled by the Scheffe type procedures given in 
GSK (1969). 
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A* Analysis of One-Population Example 

The comparisons required to answer the questions associated with the 
exanple in Section II. A can be described more clearly within the context 

two sub-tables of Table 1 corresponding to the cross-classification of 
theXtwo attributes at each time point as shown in Table 3. 



Insert Table 3 About Here 



This study involves s = 1 3ub-population, t = 2 time points (Tl and T2), 

d = 2 attributes ^CAl and A2), L = 2 response categories for A. and 

t 2 

= 2 response categories for A^- Thus^ there are r = (i-jL^) = 4 = 16 
possible multivariate response profiles. 

The functions required to test the hypotheses involving the first- 
order marginal distributions can be generated in the formulation of (A. 14) 
by' using 



0000 0000 1111 1111 

0000 11-11 0000 1111 

0011 0011 0011 0011 

0101 0101 0101 0101 



(IV. 1) 



Thjts yields the function vector 

F' = (0.'598,- 0.441, 0.729, 0.788),' 



(IV. 2) 



which contains the occurrence rates of Al and A2 at each of the time 
points as shown in Figure 1. 



Insert Figure 1 About Here 
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Table 3 

CROSS CU'SSIFICATIONvOF ATTRIBUTE DATA BY TIMr POiNTS 



Time Point 
Attribute 



Tl 
A2 



12 
A2 





Category 


1 


2 


TOTAL 


Category 


1 


2 


TOTAL 




1 


180 


35 


213 


1 


57 


39 


96 


Al 


2 


18 


125 


141 


2 


13 


240 


258 




TOTAL 


198 


156 


354 


TOTAL 


75 


279 


354 
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Figure 1-- Occurrence rates of two attributes 
(Al, A2) at each of two time points 
(Tl, T2). 
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Consequently, the hypotheses associated with question (l)-(3) ctin be 

/ 

tested in the linear models phase o^ the analysis by setting X = 
and testing each o£ the following contrast matrices: 



?1 = 


! 


0 


-1 
0 


0 

1 


o' 
-1_ 




(IV. 3) 


c„ = 




-1 


0 


0^ 


1 : 


(IV. 4) 


^3 = 


1 


0 


0 


1 




1 - 


(IV. 5) 


^4 = 




~1 

0 


0 

1 


-1 

0 


o" 


1 ■ 


(IV. 6) 


^5 = 




[' 


0 


-1 


o' 




(TV. 7) 








1 


0 




(IV. 8) 








-1 


-1 




] 


(IV. 9) 



The hypotheses from Section III which correspond to the C matrices , and 
tne resulting test, statistics are given in Table 4* These results 
suggest that significant differences (a = O.OSj exist between the 
occurrence rates of the attributes at each of the time points, and 
that the occurrence rates of each attribute are significantly different 
(a = 0.01) betvveen the time points. Otherwise, the attribute x time 
interaction is not significant (a = 0.25), which indicates the simi- 
larity of the change over time in the occurrence rates of the two 
attributes. 



Insert Table 4 About Here 
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Table 4 

TErrS Of KVPOTHESES INVOLVISG SMGimL DISTRIBUTIONS 




Hamh^ attributes 



C CTl 8 T2) 

(Tl) 
C3 (T2) 

«I^«^ "^'^ 



C CAl 5 A2) 



(A2) 



u • ■ ATTRIBUTE X TIME 
AT' 



0.05 



* signifi-ant at a 
** significant at a - U-ui- 



2 
■ 1 
1 



2 
1 
1 



13.32** 
4.47* 
7>91** 

268.52** 
162.33** 
188.49** 



0.32 



t 
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The data From Table 1 can also be displayed in terms of the joint 
distribution of the tv^o attributes cross-classified by the time points 
as shown in Table 5. In this context, the bivariate distributions of 
the two attributes for Tl and T2 are suinmarized in the row and column 
margins respectively. This joint distribution can be generated for 
each time point in the formulation of (A. 14) by using 



6i = 



nil 0000 0000 0000 

0000 nil 0000 0000 

0000 0000 nil 0000 

1000 1000 1000 1000 

0100 0100 0100 0100 

0010 0010 0010 0010 



(ivno) 



Insert Table 5 About Here 



Then by setting X = I^, the h>Tothesis H^jp in (III. 13) associated with 
question (4) concetning differences between the two time points can be 
tested b>- using 



C = 



i 0 0 -1 0 0 
0 10 0-10 
0 0 1 0 0 -1 



(IV. 11) 



For 'these. dj--i, the test statistic for IL^j^ is Q^, = 26b. 53 with d.f. = .3, 
which implies sign\ficant differences (a = 0.01) between the joint dis- 
tributions cf Al 'inJ A2 at the two ".iue points. In particular, we 
observe in Tcb'.e 5 that the major difference in the bivariate distri- 
butions is the shift from the large proportion (180/354) of the subjects 
who had neither attribute present dt Tl to the large proportion (240/354) 
who had both attributes present at T2. However, we also note that this 
shift was r.o: attrii-utable only to individual subjects moving directly 
fro.Ti (11! tc (22). In fact, this distributional change is duo to the 
high probability (4S/51) of su)jccC3 who had o.Uy one of the attributes 
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Table 5 

JOINT DISTRIBUTION OF ATTRIBUTES CROSS CLASSIFIED 
BY TIME POINTS 



Time Point . • 



^ .Attribute 



categories 
(Al, A2) 


11 

r 


12 


21 


22 • 


TOt/|fc^ 


11 


57 


36 


18 


69 


180 


Tl 1^ 


0 


0 


0 


33 


33 


21 


0 


3 


0 


15 


18 


22 


0 

» 


0 


0 


123 


123- • ■ 


TOTAL . 


57 


59 


18 


240 


354 




1 1 



ERIC 



234 

255 



present Tl novinji to the state of having both attributes present at 
T2,' together with the tendency for those who had neither attribute 
present at Tl to progress to having either one or both of the attributes 
present at T2. 

Al'though observed frequencies of zero as displayed in Table 5 can 
cause computational problems in certain applications, their presence is 
not troublesome here. In principle, this table has 15 degrees of free- 
dom, but in terms of the observed data there are effectively only 7 d.f. 
which can be manipulated (without computational singularities as dis- 
cussed in the Appendix), unless 'certain zero cells are replaced by 0.5. 
However, the 6 functions associated with the bivariate distributions 
specified in (IV. 10) do not require such artificial data adjustments; 
thus, they can be analyzed directly. For a more detailed discussion 
concerning the treatment of observed zeros, see Koch e^ al. (1977). 

Furthermore, the measures of association and agreement between 'Al 
■ and A2 in Section III can be generated as compounded functions of the 
underlying vectcr^of proportions. In particular, for each of the two 
time poi^JH^he'log cross-product ratio in (III. 10) can be generated 
in the fox-mulatipn of (A. 20) by using 

'nil 0000 0000 0000 

0000 liU 0000 0000 

UOOO 0000 nil 0000 

0000 0000 0000 11 H 
1000 1000 1000 1000 
0100 0100 0100 0100 
0010 0010 0010 0010 

0001 0001 0001 0001 

"1 -1 -f 1 0X0 0 0 



(TV. 12) 



62 



0.0 0 s0 ' 1' - 1 - 1 



(IV. 13) 
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the .measure of association Q in (III. 11) can be 'estimated in the for- 
mulation of (A. 21) "by using A^ in (IV. 12); 



^2 f 



A- 



1001 0000 

0110 0000 

0000 1001 

0000 0110 

n -f 0 0 

110 0 
0 0 -1-1 
0 0 1 Ij 



^4 



D -a 



(IV. 14). 



(IV. 15) 



(IV. 16) 



and finally, Cohen's kappa in (111.18) under the baseline constraints of 
independence can be computed in the formulation of (A.21) by letting 



A. 



^4 



1111" 
0000 

1111 

0000 

nil 

1100 
0011 
1010 
0101 
1001 



1111 

0000 
0000 

1111 

0000 
1100 
0011 
1010 
0101 
1001 



0000 

nil 
nil 

0000 
0000 
1100 
0011 
1010 
0101 
1001 



0000 

nil 

0000 

nil 
nil 

1100 
0011 
1010 
0101 
1001 



(IV. 17) 



IClOO 
10010 
01100 
01010 
00001 
00000 
00000 
00000 
00000 
00000 



ooooo] 

00000 

ooooo 
ooooo 
ooooo 

10100 
10010 
01100 
OICIO 
00001 



(IV. 18) 



^1 0 0 -1 1 0 0 0 0 0 

oil 00 000 00 
000 00-100-11 

000 00 01 100 



1 

0 



0 0 

1 -1 



(IV. 19) 



(IV. 20) 
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The estiniates of these measures, of association and agreement between 
Al and A2 for the data in Table 1, -togethet with their estimated 
standard errors are displayed in Table 6. Furthermore /the difference 
between the two time points with respect to each of these measures of 
association can be tested individually by sotting X = I2 and C - [1 -1] 
for A, Q, and k respectively. In this regard, the corresponding test 



Insert Table 6 About Here 



statistics for this hypothesis in (III. 15) associated with question (5) 
are displayed in Table 7. Here we note that although the correlation 
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structure between Al and A2 (as measured either by A or Q) did not change 
between Tl and T2> the agreenent between Al and A2 is significantly dif- 
ferent (a = 0.05) between the two time points. This decrease in the 
agreement statistic from 0.70 to 0.55 is due largely to the increase in 
the expecLcJ value for the presence of both attributes (22), without a 
corresponding increase in the observed propouion of overall agreement. 
B. Analysis of Two-Population Exanple - 

Tne exanpl/ in Section 11. B involves s = 2 sub -populations (boys, 
.girls), t = 5 tine perioJs (year 1, year 2, year 4), d = 1 behavioral 
task, and L - rc^ro'ioo catL-ori-r> (success S and failure F) . Thus, 
there are r ^ 2 ' =^ a {o^sih-c -iltivariate response profiles. 



]>7 



Table 6^ 



MEA^URESjep ASSOCIATION AND AGREEMENT 
BETIVEEN Al AND A2 



/ . 


111116 r6xiua 




Tl 


T2 


\ 


» 


Estimate 


Estimated 
Standard Error " 


Estimate 


Estimated 
Standard Error 


A 


3.62 


,0.316 . 


2.97 ' 


0.321 


■ Q 


0.95 - 


0.016 


0.90 


0.050 


>: 


0.70 


0.038 


0.56 


O.051 
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Table 7 



TEST STATISTICS FOR TIME DIFFERENCES IN MEASURES 
OF ASSOCIATION' AND AGREEMENT BETWEEN' Al- AND A2 



Hypothesis 



d.f. 





= ^2 




1 




= ^2 




1 








1 




= ^2 







* sisnificant 




2.02 
1.76 
5.03' 
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In this regard, differences .in the growth profiles for the boys and girls 



can be investigated by using 



^1 = 



1 1 1 1 0 0 0 0 
0 0 OP 0 1 1 1 1 
110 0 110 0 
0 0 1 1 0 0 1 1 
10 10 10 10 
0 10 10 10 1 



% I: 



(IV. 21) 



to generate estimates for the first-order marginal probabilities of 
success (S) shown in Figure 2 and failure (F) for each time x sex group 
combination in the formulation of (A. 14), where Q denotes Kronegker 
product of matrices and I^ is the u x u identity matrix. 



Insert Figure 2 About Here 



Although a straightforward profile analysis could be performed directly 
on tiiese estimated marginal probabilities, we will illustrate an 
alternative approach involving an underlying logistic model which is 
often of interest in growth studies (e.g., see Kowalski and Guire, 1974, 
and, Guire and Kowalski, this volume). The<^e involve log ratios or 
logit functions which can.be generated in the formulation of (A. 20) 
by selecting A^ = [1 -1] y I^, together with A^ in (IV.21). These 
estimated probabilities of success and their corresponding logits, to- 
gether vvith their respective estimated standard errors are shown in 
Table 8. 
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For this analysis, let denote the as>'mptotic expected value 
of the lo;>it corresponding; to the i-th sex and g-th year. If time 
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YEARS 



Fi-.'-.re 2-- Probibility of success (PCS)] on a behavioral 

^^^^ .^^ j^-^^^^ girls at three different years 
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Table 8 

OBSERVED AND PREDICTED ESTBLVFES FOR 
FIRST ORDER NURGIKAL PROBABILITIES 
OF SUCCESS AND CORRESPONDING LOGITS 



Observed Observed Predicted Predicted 

Sex est. prob. Est. est. Est. est. Est. est. prob. Est. 

Group Year success s.e. logit s.e. logit s.e. success, s.e. 



Boys 


1 


0. 


03 


0. 


01 


-3. 


45 


0. 


45 


-2. 


99 


0. 


20 


0. 


05 


0.01 


Boys 


2 


0. 


22 


0. 


03 


-1. 


29 


0. 


19 


-1. 


50 


0. 


14 


0. 


18 


0.02 


Boys 


4 


0. 


48 


0. 


04 


-0. 


10 


0. 


16 


0. 


00 


0. 


14 


0. 


50 


0.03 


Girls 


1 


0 


IS 


0 


03 


-1 


50 


0 


18 


-1 


48 


0. 


14 


0. 


19 


0.02 


Girls 


2 


0 


50 


0 


.05 


-0 


.01 


0 


14 


0 


.01 


0 


09 


0 


50 


0.02 


Girls 


4 


0 


.85 


0 


.05 


1 


.57 


0 


. 18 


1 


.51 


0 


14' 


0 


.82 


0.02 



is assumed to represent a metric which is analogous to drug dosage 
in quantal bioassay research, then the linear logistic model with 
respect to log time represents a rea-sonable model by analogy to well 
known results discussed by Berkson (1944, 1955, 1955) or Finney (1964) 
More specifically, we first consider the model 

1,2 



= y. + Y.X. for i 

^ ^ ^2 g . 1,2,3 



(IV. 22) 



where represents an intercept parameter *in reference to year 1 which 
is associated with the i-th sex, represents a corresponding contin- 
uous slope effect over time, and x^^ is the log to the base 2 of year 
g for the i-th sex. In matrix notation, this model. can be fitted via the 
regression model 



^ ^1^1 



1 


0 


0 


0 






1 


1 


0 


0 






1 


2 


0 


0 




0 


0 


1 


0 






0 


0 


1 


1 




0 


0 


1 


2 






^2 



(IV. 23) 



for which the goodness of fit statistic is Q = 2.29 with d.f. = 2. The hypo- 
theses and test statistics in Table 9 suggest differences exist among the 
respective sex groups with respect to the intercept, but not the slope. 
On the basis of these results, the original 
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model can be simplified to 



1 


0 


0 






1 


0 


1 




1 


0 


2 




^'2 


0 


1 


0 






0 


1 


1 




Y 


0 


1 


2 







(IV. 24) 
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Table-- 9 

STATISTICAL TESTS FOR X, MODEL 

\ 



Hypothesis 


d.f . 






1 

V 


18.95** 


Yi = Y2 


1 


0.22 


**significant at a =^ 0.01 





\ ■ I 



/ - 
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where is the intercept paraneter for the i-th sex group and y is 
an overall slope parar.oter. For this model, the goodness of fit 
statistic is Q = 2.5i with d.f. = 5, which suggests that this reduced 
model provides a satisfactory characterization of the variation among 
the legits. The corresponding estimated parameter vector and its 
Estimated covariance matrix are given in (IV. 25). 



-2 


.99 




3 


.99 






-1 


48 




1 


.60 


1.94 


X 


1 


.50 


--2 


-1 


.60 


-1.07 1.0,7 



















X 10 
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From these results, the predicted logits shown in Table 8 can be deter- 
mined via (A. 12). These can then be used to obtain the predicted 
values for the frst-order uarginal probabilities of success (S) responses 
by reverse transformation which are illustrated in considerably more 
detail in Koch et aj^. (1977) and Landis et al^.. (1976). Tuese quantities 
are also shown in Table S and^ are plotted in Figure 5 within the context 
of fitted logistic curves. Lstinated standard errors for these predicted 
values obtained through suitable manipulations of (A. 13) are substantially 
smaller than those for the corresponding observed estimates, and thus 
reflect the extent to which the fitted ^model enhances statistical 



efficiency. 



insert Figure 3 .-Xbout Here 

rinally, it L.-.n be s!iO--i thct for this linear logistic model the 
paranerric tunci ions c.p f-> ./-ij r-nrcbcn-. the median ago<^ fur success- 
ful perfor-i:-:e oi the LchiMor.a ta->!. (the h-D-SO analogue from bioassay 
studies) IV. tile i-th s.a <:ro:.p. t-tinatc^ for these quantities are 
obtainvd a-, joi : . s^''J f '.^^ t ic-, •-■ of and arc shown in Tablc'lO. 
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Fieure . -- Fitted logistic curves to probability of 
success on a behavioral task [P(S)] for 
boys and girls at three different years 
of aco. 
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V. DISCUSSION 



Although the methodology for the analysis of longitudinal data 
developed in this paper is quite general, these procedures have been 
illustrated with relatively simple examples. However, for situations 
in which either the number of time points t, the number of attributes 
d, or the number of categories L^, moderately large, 

the number of possible multivariate response profiles r = i^i^2'-'"^d^^ 
becomes extremely large. Consequently, the matrices required to 
implement the GSK procedures directly may be outside the scope of 
computational feasibility." In addition, for each of the s ^ub-populations 
many of the r possible response profiles .will not necessarily be observed 
in the respective samples so that corresponding cell frequencies are 
zero. r\\us, in such cases, specialized computing procedures are required 
to obtain the estimates of the pertinent functions. ' 

One alternative approach for handling such very larg^ contingency ^ 
tables in which most of the observed cell frequencies are zero is 
discussed in Koch et'al. (1977) and is illustrated in Landis and Koch 
(1977b). Specifically, this approach permits the same estimators which 
would need to be obtained from the conceptual multidimensional contin- 
gency table to be generated by first forming appropriate indicator 
variables of the raw da from each subject, and then computing the 
across-subject arithmetic means. Subsequent to these preliminary steps, 
the usual matrix operations discussed in the Appendix can then be 
applied to these indicator variable means to generate the required 
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Table 10 



ESTIMATED MEDIAN AGE FOR SUCCESSFUL 
PERFORMANCE OF B£HAVIOR.'\L TASK 



Sex Estimated Estimated 

Group Median Age Standard Error 

Boys 4.00 -0.25 

Girls 1.99 0.09 
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functions. These alternative computations involving raw data, is well 
as these involving standard contingency table data, can all be performed 
via the computer program GENCAT discussed in Landis et al.. (1976). 

Othenvise. several additional potential difficulties associated 
with the introauctory. remarks in Section III may arise in the analysis 
of longitudinilSata in studies of human growth and development. First 
of all, if the response profiles a^e assumed to be structured (e.g., as 
specified by certain irreversible growth or learning patterns as discussed 
in WohlwiU. 1973). some of the ...^ will be zero. In such situations, , 
analogous hypotheses to those discussed in Section III that reflect 
these restrictions imposed by such structures can be taken into account 
by suitably modifying the definition of the appropriate hypotheses. In 
partis^ular. the hypotheses pertaining to the first-order marginal 
probabilities are still appropriate here because their formulation is 
consistent with the available degrees of freedom. However, the higher order 
margins involving joint distributions or measures of association may not 
be> feasible depending specifically on the nature of the restrictions 
involved. Secondly, the methods discussed in Koch. Johnson, and Tolley . 
(1972) represent, a life table approach to dealin, with the issues involved 
with si^bjects who are lost-to-follow-up. Finally, for a discussion of 
one approach to the analysis of incomplete data resulting from tne 
failure to measure c .ch subject on each attribute at each time point, 
see Koch, Imrey. and Rcinfurt (1972). 

SU>^URY 

In thi. paper we have propo.ea an extremely general approach . 
to th'e analysis of nultivariatc categorical data associated with 
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longitudinal investigations of human growth and development. For 
^purposes of illustration, two hypothetical data sets were presented 
to .indicate the range of statistical issues of interest in such studies, 
and the types of functions from corresponding multidimensional contin- 
• gency tables which can be used to suggest answers to these questions. 

Within this context, a general methodology for the analysis of categorical 
data resulting from longitudinal studies was then developed in terms 
of specific hypotheses. In particular, hypotheses directed at questions 
'^pertaining to average differences among sub-populations, atSpributes, and 
time points weTe expressed in terms of constraints on the probabilities 
associated with first-order marginal distributions of the response pro- 
files. Furthexmore, hypotheses directed at relationships among the 
attributes at a given time point and the extent to which those relation- 
ships change across time were formulated in terms of comparisons^ among 
joint distributions and in terms of measures of association across time- > 
periods . 

A general unifying approach to the analysis of multivariate cate- _ 
gorical data was recommended to create test statistics for these hypo- 
theses as well as estimators for corresponding model- parameters . ' Tliis 
procedure can be implemented by constructing the appropriate functions of 
the observed proportions which are directed at the relationships under 
investigation by a sequence of matrix op'^rations. Then a weighted 
least squares computational algorithm is used to generate linearized 
minimum modified chi-square statistics as discussed in more detail in 
the Appendix. 

An extensive analysis of e.ich of the two data sets was presented 
within the context of the h^-pothe.es of interest. In this regard, the 



matrices roquirod to generate ttlie 'appropriate functions and the matrices 
used to compute the test statistics wer(5 all specified in detail. 
Furthermore, the fitting of final c^noothed models was illustrated in the 
second example in tenns of an underlying linear logistic model often . 
considered in growth studies. In particular, this modeling permitted the 
estimation of predicted values for the first-order marginal probabilities, 
together vith their estimated standard errors, even though the analysis 
was performed on the logit transform scale. 

Finally, this paper concludes with a discussion of certa>-n computa- 
tional difficulties associated with very large contingency tables, togethe 
with other potential difficulties associated with structure 1 response 
profiles, missing data, and incomplete data. 



Appendix 

Let j = l,j,...,r index a set of Cvite^^ories which correspond to the , 
r possible response profiles assocLatod with the simultaneous classifi- 
cations of the subjects on the d attributes. Similarly, let i - l,2,...,s 
index a set of cate^^ories uhich correspond to distinct sub^populations as 
defined in tenns of pertinent* independent variables. If samples of size 

where i = l,2,...,s are independently selected from the respective sub- 
pcpulations, then the resulting data can be summarized in an (s x r) 
contirc^ency table as shown in Table 11, where n^^ denotes the frequency 
of response category j in the sample from the i-th sub-population. 



Insert Table 11 ab6u^ hero 




The vector n., where = (n^, ,n^^/\ . . ,n^^) will be assumed to follow 
the multinomial distribution wit^\ parameters n. and it^' = ^^il '^i2 ' * * ' '^ir-^ ' 

whert* r represents the probability that a randomly selected element from 

13 ' . 

the i-th population is classified ir the j^-th response category. Thus, 
the reiovant |.roJact r^altinor^ial rodel ?s , . ' 



1=1 



/ 



n : 

1 1 



(A.I) 



with the cop.strunt 



- 1 



(A. 2) 
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Table 11 
OBSLRVED CONTINGENCY TABLE 



Sub-population 




.Response 


profile 


categories 




I 


2 




r 


Totaf 


1 








Ir 




2 


' "21 


'''22 




n 

2r 


"2 


s 


"si 








n 

s 


/ 












r 



■ y 
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Let ^ f'^i/^i^ -"^ ^5 vector of observed proportions 

associated \sith the sample from the i-th sub-population and let p bo 
the (sr X 1) compound vector defined by p* = (pj, P2*---'Ps)- Thus, 
the vector p is the unrestricted raaximum likelihood estimator of tt 
where tt» = ,^;> • - • ,^') • A consistent estimator for the covariance 
matrix of p is given by the (sr x sr) block diagonal matrix V(p) with 
the matrices 



!i 



1 -p-pH 

— _p. -1-1 

n.; t.1 

1 I— 



(A. 3) 

— 1 -P^ -^"-H 

(r'<r) 

for i = l,2,...$s on the main diagonal, where D is an (r x r) diagonal 



■matrix with elements of the vector p^ on the main diagonal. 

Let F^(p),F2(p),...,F^^(p) be a Svt of u functions of p which pertain 
to some aspect of the relationship between the distribution of the 
response profiles and the nature of the sub-populations. Each of tho>v> 
functions is assumed to have continuous partial derivatives through order 
two with r.espect to the elements of p within an open region containing 
IT = iUp}.. If F ^ F(p) is defined by 

F- = [F(p)]' = [F (?),F^(p),...,F (p)3 , (A.4) 

then a consistent estimator for the covariance matrix of F is the (u x 
ii) matrix 

Vp = H[V(p)3H' " f-^-^^ 

where H"= [dF(x)/dx 1 x = jj is tho (a x sr) matrix of fir-^c partial 
deri*fal(ives of the functions F evaluated at p. In all ni^pli cat ions, the 
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functions comprising F are chosen so tRat Vp is asymptotically non- 
singular* ' 

The function vector F is a consistent estimator of F(7r). Hence, the 
variation among the elements of ?(r) can be investigated by fitting linear 
regression models by the method of weighted least squares. This phase of 
the analysis can be characterized by \«:iting 

{F} = {FCp)} = FCtt) = XB. (A. 6) 

where X is a pre-specif ied (u x t) design (or independent variable) matrix 
o£ known coefficients with full rank t £ u, 3 is an unknown (t x 1) vector 
of parameters, and **E.** means "asymptotic expectation.*' 

An appropriate test statistic for the goodness of fit of the model 
(A. 6) is 

■J 

Q = Q(X,F) = (RF)' [R Vp R']"^ RF, . (A.7) 

where R is any full rank ((u-t) x u] matrix orthogonal to X- Here Q is 

2 

approximately distributed according to the X distribution with d.f. = 
(u-t) if the sample sizesjn.} are Luff iciently large that the elements 
of the vector F have an approximate multivariate normal distribution as 
a consequence of Central Limit Theory- (CIT). Test statistics such as Q 
are known as generalized V/ald (1943) statistics and various aspects of 
their application to a broad range .of problems involving the analysis 
of multivariate categorical data are discussed in Bhapkar and Koch (1968a, 
1968b) and Grizzle et al. (1969). 

Ho\;ever, these test statistics like fA.7) are obtained in actual 
practice by using weighted , least squares as a computational algorithm 
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which is justified on the basis of the fact that Q of (A. 7) is 
identically equal to 

Q = (P-^b)' -Vp^^ (F-Xb), (A^8) 

where b = (X» Vp"""^ X)'"^ X' Vp""-^ F is a BAN estimator for 6 based on the 
linearized modified Xj -statistic of Neyman (1949). In view of this 
identity demonstrated in Bhapkar fl966), both Q and b are regarded as 
having reasonable statistical properties in samples which are suffi- 
ciently large for applying CLT to the functions F. As a result, a 
consistent estimator for the co variance matrix of b is given by 

!b " C^'V'"'X)'^ . (A-.9) 

If the inodel (A. 6) does adequately characterize the vector F(ir), 
tests of linear hypotheses pertaining to the parameters 3 can be under- 
taken by standard multiple i egression procedures'. In particular, for a 
general hypothesis of the form, 

\>rhere C is a known (c x t) matrix of full rank c £t and 0 is a (c x 1) 
vector of 0*s, a suitable test statistii. is 

which has approximately a x^-distribution with u.f. c in large sample 
under in (A. 10). 

In this framework, the test statistic reflects the amount by 
which the goodness of fit statistic (A. 8) would increase if the aodel 
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J 

(A. 6) Were simplified (or reduced) by substitutions based on the addi- 
tional constraints implied by (A. 10). Thus, these methods permit the 
total variation within F(u) to be partitioned into specific sources and 
hence represent a statistically valid analysis of variance for the 
corresponding estimator functions 

Predicted values for F(u) based on the model (A. 6) can be calculated 

from 

F = Xb = X(X»Vp"^X)"-^X'Vp"'^F , (A- 12) 

Thus, consistent estimators for the variances of the elements of F can be 
obtained from the diagonal lements of 

Vp = X(X'Vp"'^X)^'^X' . (A. 13) 

The predicted values F not only have the advantage of characterizing 
esu.sentially all the important features of the variation in F(it), but 
also represent better est ina tors than the original function statistics 
F since they are based on the data from the entire sample as opposed 
to its component parts. Moreover, they are descriptively advantageous 
in the sense that they make trends more apparent end permit a clearer 
interpretation of the relationship between Fiv) and the variables 
comprising the columiiS of X. 

^ Although the formulation of F(p) can be quite general. Grizzle et 
al. (1969) and Forthofer and Koch (1973) demonstrated that .a wide range 
of problems m categorical data analysis could be considered within 
the framework of a few specified classes of compounded logarithmic, 
exponential, and linear functions of the observed proportions. However, 
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v| those functions are all special cases of a broad class of functions 

^vhich can be expressed in terms of repeated applications of any se~ 
quence of the following matrix opei^ations: 

(i) Linear transformations of the type 

F^CP? = A^P = f X > . ' CA-14) 

where is a matrix of kno\^ constants; 

(ii) Logarithmic transformations of the t^ype 

= loggCp) = , \ (A. 15) 

where log transforms a vector to the corresponding 
vector of natural logarithms; . 

(iii) Exponential transformations of th'^ type • 

F Cp) = expCp) = a^ (Aa6) 

where exp transforms a vector to the corresponding 
vector of exponential functions, i*e*, of antilogarithms. 
Then the lineariised Taylor-series-based estimate of the covariance 
matrix of for 1,2,3, is given by (A. 5), where the corresponding 
matrix operator is = ; • (A. 17) 

H, --■ 0 (A. 18) 

H- = D: ; ■ (A. 19) 

where D^^ is a diagonal matrix with eT.ements of the vector y on the ain 

diagonal. 

The hypotheses involving marginal distributions ean all be tested 
in terms of linear functions of the for give^ in (A. 14). Furthermore, 
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log-linear functions of the form 

/ 

F(p) = { l?§e^^l?^^ 

can be.use-1 to -enerate logits and log cross-product ratios; «hereas 
compounded functions of the form 

F (p) = explA^ClogjA^texpCA^floggCA^p]}; ')]> CA.21) 

can be used to generate complex ratio estimates such as Yule's Q statis- 
tic or generalized kappa-type statistics. As a result, the linearized 
Taylor-series-based estimates of the covariance matrices associated with 
. F(p) in (A.20) and (A.21) can be obtained by repeated application of 
-4he chain rule tor matrix differentiation. In particular, let 



^ . CA.22) 

aj^ = A^p ; ^ ^ 

a = exp{A2[loggCapi} ; ^^'^^^ 

^kH:^ , . (A.24: 



Then the results in (A. 17) -(A. 19) can be used to provide a consistent 

+^-iv (^ 5^ for FCp) in (A.20) by using 
estimate of the covariance i..dtrix Via {.k.b) tor t^(.pj 



H = A^D-n, (A.26) 



and for FCp) in (A.21) by using 

r^A D A.D"-^A. . (A. 27) 



« A.D'^A D A D A 
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Finally, Koch, Imrey, Freeman, and Toliey (1976) discuss the 
application o£ this general approach to^ implicitly defined functions 
of p in the context of estimated parameters from fitted log-imear 
models; Thus, all aspects of this niethodology can be directed at 
implicit functions which are based on maximum likelihood estimation 
^ equations corresponding to' preliminary or intermediate (as opposed to 
final) models with a priori assumed validity; in other words, models 
in which the likelihood (A.l) initially (i*e., prior to any data 
analysis) satisfies both (A. 2) as well as certain other constraints 
analogous to (A.6)* 

For purposes of completeness, it should be noted that other statis 
tical procedures for the analysis of categorical data from longitudinal 
and other types of repeated measurement experiments are' available in 
the literature • In this regard. Bishop, Fienberg, and Holland (1975,^ 
Chapter 8) discuss the application of maximum likelihood methods to 
test hypotheses of total symmetry ind marginal symmetry as well as 
certain ojher hypotheses of intere<^t. They also provide a relatively 
complete literature review of other papers dealing with similar 
questions including the early work of Bowker (1948) . 
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, ABSTRACT 

The use of causal models in longitudinal" research is discussed^ with emphasis 
on their logic pid construction. Advantages of longitudinal designs over 
cross-seccional designs for n^aking causal statements are presented first* 
'Following an argument for theory-based research, the usefulness of causal 

models fur incorporating' substantive theory and knowledge into the data 

\ 

anklysis model is stressed. The construction of causal models from substantive 
examples is explained and illustrated as a two-stage process involving (1) the 
structural model which specifies* the delations of the important constructs, 
and (2) the measurement model which relates the unobserved constructs to their 
observable measures* Longitudinal panel designs are. considerea extensively, 
and causal models are constructed from two substantive investigatioas conform- 
ing *o a panel design. The use of correlations in these studies to support 
' causal statements is shown to be misleading. 
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CAUSAL MODELS IN LONGITUDINAL RESEARCH 
INTRODUCTION 

In this chapter a set of methods .for making causal inferences from longitu- 
dinal data will be considered. It is useful to distinguish between explanation 
(whix:h implies sone form of causal statement} and description in investigations • 
A descriptive approach addresses such questions as "how" and "how much", while 
an explanatory approach treats the question "why" and thus incorporates causal 
inference^ (See^the discussion of description vs. explanation in Wold, 1956) • 
For example, a measurement of a child's cognitive functioning is a description, 
while an investigation of the dependence of cognitive functioning on maternal 
nurturance^and the child's motivation is an example of explanation^ (Clearly, 
explanation and causal inference are appropriate when a researcher is interest- 
ed in the mechanism which generated the observable relation between variables) • 
Explanation of developmental processes is the primary focus of this chapter, 
but the discussion has clear implications for a variety of applications to 
other content domains • - 

A. Why use longitudinal data for causal inferences? 

Cross-sectional analysis was originally conceived as a practical and approp- 
riate means to study longitudinal change- However, sharp differences between 
the findings of cross-sectional and longitudinal studies have led many researchers 
to doubt the utility of the former: 

/ 

Because of the striking discrepancies in the results of 
cTOss-sectional and longitudinal investigations (Damon, 1965; 
Kiihlen, 1963), developmental psychologists have felt the need 
to formulate more sophistocated models. 
(Labouvie, Bartsch, Nessclroade, 5 Baltes, 1974, p. 288) 
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An examination of the assvunptions underlying cross-sectional designs 
explains the discrepancies. Cross-sectional analysis assumes that interindivid- 
ual differences in development are stable over time. The measurement of certain 
Individuals at one time period, then, would presumably yield the same results 
as would the measurement of other individuals at the same developmental stages 
at a different tine. Coleman (1968) expressed this as an assumption of equilib- 



rium: 



The cross-section analysis assumes, either implicitly or explicitly, 
< 

that the causal processes have resulted in an equilibrium state. 
That is, the implicit assumption in regression analysis is that this 
is a stable relationship, which would give the same values for the 
regression coefficients in a later cross-section unless an exogenous 
[outside] factor disturbed the situation. (p. 444) 
Cross-sectional research further assumes that the interindividual diff- 
erences found between age groups can be interpreted as changes 'that an individ- 
ual would undergo across time (intraindividual change) . It has been shown, 
however, that interindividual differences in growth do not adequately measure 
intraindividual growth, but rather reflect the increasing variability in the 
rate of growth among individuals (Huston-Stein 5 Baltes, in press).. Thus, 
Baltes and Willis (1976) stated: 

change on the individual level involves intraindividual change, and 
differences in change functions. between individuals [involve] inter-, 

individual differences in change One of the important features ^ 

of aging is that interindividual differences typically increase with 
time and age, resulting in progressively less age-related homogeneity. 

(p. 12, italics in original) 
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Because cross-sectional studies confound intrain dividual growth with ^ . 
interindividual differences in intraindividual growth (Baltes- & Nesselroade, 
1973), they are a po^ method for studying change. These problems with cross-, ^ , 
sectional designs have been noted in other research contexts: 

Repeated cross-sections from a panel of organizations- which arfif out 
of equilibrium will ordinarily produce estimate^ varying considerably 
from cro«s-section to cross-section.... It should be apparent that, 

• ■ * ■ if -the -processes of ^ study are not symmetric in growth and decline, 

cross-sectional analysis mixing growers and decllners will obscure 

' ' . 

/ the processes of interest. 

C (Freeman § Hannan, 1975, p. 216)'^ 
, ..x...^,...---, - . 8) argued thaf repeated raeasvres designs are more 

useful than cross -sectional designs^in"demonstraU^ causality: 

Ifhen variables are obserf-ed' at t^^ or morV^oints in time, additional » 
information exists beyond\hat obtained in c>oss-sectional data. ^ v 
This is information which, i£^.used properly, can indicate what 
factors bring^about change in ^a variable. These changes will, of 
course, create or jnaintain theUelationship^s that may be found in 
cross-sectional data, and th;is provide information, about the dynamics 
of a svstem beyond that provided by cross-^sectional "data. (p. 445) 
.Th^e yse of temporal variation to establish causality is a major aspect of the 
rationale for the longitudinal panel desigiis in section IV. . * - 

Another advantage of longitudinal research lies in untangling the^complex 
■ effects of reciprocal causation or what some have.^called "causaf I'oops" (Hannan 

• 5 Young, 1974). Examples of reciprocal causation are the reciprocal influences^ 
(of mother-on-child and child-on-mother) in a mother-child dyads (Lewis_ § 
Ucsonblum, 1974; Uogosti f, Ambvon, 1976). 
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An example from research on personality development illustrates this 
point. A number of cross -sectional studies have shown that "there is no. quest- 
ion that there is a persistent relationship between the self and academic 
.achievement [knd] that therfe is a continuous interaction between the self and 
academic 'acheivement, and that each directly influences the other" (Purkey, 
1970, p. 23). In a longitudinal study of these variables, O'Mally and Bachman 
(1976) explained the advantages- of such a design: ■ _ 
J ■ There is reason to believe that self-esteem is linked to educational 
and occupational attainment, and that this linkage probably involved 
a number of different and complexly interrelated patterns of causat- 
ion. Itfhile it is a rather simple matter to point out the complexities 
the problem of disentangling such reciprocal causation is extremely 
difficult and Viexing. In most cases the empirical evidence is . 
limited to a static relationship at a single pbint in time— e.g. , 
survey respondents with higher levels of educational attainment also 
have higher mean scores oji' a measure of self-esteem. While such 
findings are important ii^ demonstrating that a relationship does 

exist, they leave us largely in the dark about causal dynamics., (p. 5) 
• B. Longitudinal FSesearch and oias'sical Experimental Design and Analysis 

■ While longitudinal designs are preferable to cross-sectional ones in terms 

■ 

of demonstrating causality and studying intraindividual change, they also 
create practical problems. Most jlongitudinal studies tnust be performed outside 
of controlled laboratory settings, where the characteristic features of classic- 
al experimentation-control of extraneous influences, manipulation of treatment 
variables, and equivalent experimental groups-are frequently impossible to 
implement. Furthermore, developLntal studies often focus on relations of ^ 
variables that cannot be controlled or manipulated (e.g., organismic variables) 



ir 
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One advantage of this break with classical experimental' "design lies in the 
increased" ecological validity of naturalistic studies which decreases tlie 
threat to the external validity or generalizability of the study (Bracht 5 
Glass, 1968)." Bronfenbrenner (1974, 1976) argfued persuasively for the necessity 
I of ecological y<;llidity in developmental research and claimed that "much' of 
development/psychology is the science of the strange behavior of children in 
strange situations with strange, adults for the briefest possible periods of 
" - time (1974, p. 3):. Bronfenbrenner (1976)' called(for a new perspective in 
. developmental research termed "the experimental ecology o£ education". 

The increasing recognition of the" need for naturalistic, longitudinal 
- studies has led to a press. for the development of appropriate design and analy- 
tic techniques. From the perspective of life-span psychology (Huston-Stein and 
Baltes, in press) stated that "most of the traditional, experimental design 
methods in the psychological sciences are Ill-suited for the assessment of 
long-term chains and distal causes. Therefore, life-spaS researchers have 
pointed to" the general usefulness of quasi- experimental designs" (pUl). Giveii 
the break in design strategies with traditional psychological experimentation, 
the analysis techniques successful in makirtg causal inferenc^es from experimental 
data are not likely to be useful for the analysis of causal patterns in natural- 
istic studies. Wiley and Hornik (1973) discussed this trend in design and 
analysis 

Sociological and social-psychological research workers have long been 
.concerned with the attribution of causality to, variables representing 
basic sociological or psychological concepts. Given the difficulty 
of variable manipulation in many real social settings, scientists 
have turned to statistical methodology rather than experimental 
tccluiiqucs of investigation for help, (p.l)^ 
' Huston-Stein and Baltes (in press) speculated that "with more powerful 
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methods of inferring causal relationships from naturalistic, correlational 
data, child deveiopmentalists may be lured away from their heavy reliance on 

laboratory experiments" CP- H) • Herman Wold (1956) in a paper "Causal ^nference 

■■■ 't 

from observational data", indicated one path to "the more powerful methods": 
' in the absenqe of experiments the statistical analysis has to be 
closely coordinated with subject-matter theory both in specifying the 
causal hypotheses^andJ.n-^testing them against other sources of know- 
ledcre. A crucia] feature is randomization, which in experimental 
situations reduces the disturbing effect of uncontrolled, variation* 
' This device not being a.ailable in observational situations, it is a 
pertinent problem to what extent the. disturbance factors should be 
taken into explicit account, and at this point strong reliance raust 
fall upon subject-matter argument, (p. 31) 
The attribution of causal effects from nonexperimental data can be accom- 
plished, through, causal models which incorporate substantive knowledge into the 
analysis of data as a substitute for experimental controls. The process by 
which substantive knowledge is incorporated into the data analysis in a causal 
model through the construction of causal models from' longitudinal studies is 
illustrated in sections III and IV. - . 

II. LOGIC OF CAUSAL M0DEL3 



A. Theory-based Research 

A strong appeal for theory-based research was made by Suppes (1973): 
I think the time has come to call for a much deeper theoretical 
orientation of research in education in order thereby to increase its 
relevance. In many areas, the greatest limitation on- research is not 

the absence of hard-data studies, but the absence of serious and 

'")•'' ' 

sophisticated theory (p. 23)-' 
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Suppes /ejects the "fifcm prejudices and soggy arguments" common in educational , 
debate in favor of "well -put- together theories that have definite and precise 
assumptions and deductive conseqliences that bear on behavior and the way students 
learn" (p. 24). Suppes (1974) argues that theory goes beyond empiricism to 
explain the complexity of phenomena. -He attacks the "triviality of bare empiric- 
ism" which at the extreme is the simple recording of facts that leads nowhere. ' 
A similar criticism was voiced by Einhom (1972) : 

As methoti and techniques get more complicated, the role of theory in 
research is being dangerously ignored in favor of purely empirical 
work that proceeds without so much as a hypothesis. Like Pirandello's 
characters in search of an author, many of today's researchers seem 
to have an assortment of techniques in search of a substantive problem. 

(p. 367). ' • 

' In order to guide research , theory should be explicit about the relations 
of its Coraponents-that is, be translatable into empirically justificable 
stateraents-since vague, verbal theories (which Suppes terms fantasies) will 
rarely help to focus research. One of Suppes' examples of fantasies in educat- 
, ional researches Piagefs concept of developmental states since it"operates 
in large theoretical terms and with little regard for detailed experimental 
investigation" (Suppes, 1973, p. 13). 
< T Phillips and Kelly (1975) examined the "much-touted Hierarchical theories 

of development": ■ . >_ _ 

\ Hierarchical theories may be potentially useful in understanding 
human development. At the present time, however, the scientific 
status of. such theoriet is obscure. In the flurry of experimental 
research on child development, it is not always clear what type of 
■ evidence would count as confirmation or refutation of such a theory, 
or indeed whether empirical research is relevant at all. These and 



related issues have not been totally ignored in the literature, but 
* ' discussion has been hampered by the failure to draw some important 
distinctions and to make explicit certain underlying assumptions, 
(p. 352) 

The strongest condemnation of obscure, vague theory is provided in Popper *s 
(1972) . discussion of the psychological theories of Freud and Alder* 

This does not mean that Freud and Adler were not seeing certain 
•things correctly I personally do not -doubt that much of what they 
say is of considerable importance, and may well play its part one day 
in a psycho-logical science which is testable. But it does mean that 
those "clinical observations" which analysts naively believe confirm 
their theory cannot dp this anymore than the daily confirmations^ 
which astrologers find in their practice* And as for Freud's epic of 
the Ego, the Super-egd, and the I^, no substantially stronger claim 
to scientific status can be made for it than for Homer's collected 
stories from Olympus* These theories describe some facts, but in the 
manner of myths. They contain most interesting psychological suggest- 
ions, but not in a testable form. (p. 23) » - 
Explicit, statments of theory are essential for worthwhile theory-based 
research. Many developmental theories are stated ambiguously; consequently, 
they are often misinterpreted and are difficult for the researcher to test. 
Theorists use notions like causes, forces, systems, properties, schemes, and 
stages. The research must infer the relations of these terms from the incomplete 
specification provided by the theory and must select or develop measures that 
act as indicators for the unmeasured variables in the theory. Unfortunately 
there are substantial variations in the ways researchers interpret theory. The 
more ambiguously .the theory is stated, the more confused are the results of 
empirical investigations* 



The gap between theory and, research is not uncommon in social science. 
Blalock (1963) described the problem in sociology and one approach to a solution: 
There can be little disagreement that in sociological theory we have 
'^'^ made use of numerous concepts that have been vaguely defined... 

These are the 'big words* sociologists are often accused of using* 
Sometimes they are thrown^ into theoretical discussions with almost 
reckless abandon. In other instances they may be rather vaguely 
linked with measured indicators that are referred to as * correlates * , 
• 'manifestations', or 'symptoms' of the underlying variables. Sometimes 
the 'big words' are utilized to provide explanations for empirical 
relationships, but upon detailed logical investigations we find that 
these theoretical explanations make much less sense than supposed... 
One possibility is to retain whatever vaguely defined concepts we may 
think will ultimately prove useful, while at the same time attempting, 
to spell out exactly how we might link these theoretical concepts 
with specific measured variables, (p. 62) 
The major problem for empirical research is that when theories include 
ambiguous concepts whose postulated causal relations are not well-specified, . 
the resulting research is usually a collection of non-comparable studies which 
.relate only vaguely to the original fheory. Two examples are research on Piaget's 
theory of moral development and research on attachment (Ambron and Rogosa, 
1975) . 

B. Itfhat are Causal Models? 

A causal model is a representation of the postulated causal links between 
the variables of interest and is an explicit and quantitative statement of 
theory . Through the use of causal models verbal theories *are recast in terms 
of the causal processes assumed to operate among theaivariables under considera- 
tion. The use of causal models forces the theorist and the experimenter to make 
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explicit all causal assumptions in an internally consistent system. Clearly, 
this is a large step in overcoming the problems with verbal theories. As 
Duncan (1966), asserted '.'The great merit of the path scheme, then, is that it 
makes the "assumptions explicit and tends to force the discussion to be at least 
internally consistent, so that mutually incompatable assumptions are not introd- 
uced surreptitiously into different parts of an argument extending over scores 

of pages" (p. 9) • " ■ 

In the formulation of a causal model, the important variables in the 
developmental process are first identified, for example, self-esteem, educat- 
ional attainment, occupational aspiration. Then the ca\isal links between these 
variables over time are specified. On psychological grounds some variables can 
be said to influence others; in other instances the causal link may be assumed - 
not to exist. The variables to be included in the model and their postulated 
causal links may be obtained from the theoretical formulation of the problem. 

Causal models have been discussed under a variety of names, in a number of 
different literatuVes. Structural equation models is the term used most often 
in econometrics; path analysis was formulated by Wright in genetics and brought 
over into sociology as path analysis or as causal modeling. Goldberger (1972). 
provided an interesting history of the parallel but independent historical 
developments in econometrics and biometrics. Structural equation models are 
more general in formulation and in estimation techniques than path analysis but 
the logic is nearly identical. The models in this chapter are termed causal 
models or structural equation models, but almost all comments apply to the 
special case of path analysis also. 

. Causal models are regression-based procedures. The regression equations 
which compose a causal model are called structural regression equations. 
.Systems of structural regression equations, in which each equation represents a 
:-causal-link between-variables, are distinguished from predictive regression 
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equations which represent empirical associations with no special regard for 
whether the predictor (i.e.,' independent) variables are theoretically interest- 
ing. , 4 - * , 

Predictive regressirfn, on the one hand, is concerned with identifying the 
best linear predictor of the dependent variable from a combination of the 

independent variables; any observable predictors that add to the explained 

2 

variance^ the squared multiple correlation (R ), are utilized* The usual 
multiple regression techniques are examples of predictive regression. In 
structural regression, on the other hand, the concern is with the interrelation- 
• ships of the theoretically important variables, not simply the predictability 

of one from the others. 

In structural regression, the mechanism that generated the , observations 
can be characterized in terms of more fundamental parameters. Goldberger 
(1973) proved that, ii^ general, the coefficients in predictive regression will 
be a mixture of the structural parameters;^ hence a change in one structural 
parameter may change all the predictive regression coefficients. Therefore, 
the more fundamental structural parameters have the invariance and stability- 
desired of scientific formulations. As Abraham Wald (1940) pointed out, "Th-e 
knowledge of the structural relationship is essential for constructing any 
theory in the eapirical sciences... in deducing la\^ from observations we have 
th^ task of estimating structural relationships" (p. 300). Tukey (1954) concluded, 
"Almost any causal theory comes sooner or later to deal with structural regres- , 
sion rather than predictive regression" (p. 41). 

Once a causal model is constructed, the set of causal links in the model 
are written as a set of structural regression equations. Estimating the para- 
meters in the structural regressions (see Chapter , this vollnne) yields 
estimates of the causal influences betweer^thc variables and thus is a calcula- 
tion of how change in one variable in the system will affect the other variables 
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in the system. The results of these analyses depend on the theory which deter- 
mined the structural equation model. Intuitively, the. estimation techniques for 
these structural equation models decompose the observed association of the 
variables into direct and indirect effects. We are, in some sense, taking the. 
correlation apart and examining its causal components. However, this decomposi- 
tion of the observed covariation depends upon the particular causal ordering 
assumed t^o be valid by the researcher. The incorporation of relevant substan- 
tive knowledge into the regression analysis may be termed analyzing data condit- 
ional on a theory . From the theoretical aud psychological conceptualization of 
the investigation, the observed association betwfeen the observed variables is 
specified.* Then the regression analysis proceeds to supply estimates of causal 
parameters from the nonexperimental, correlational data. Of course, the numbers 
obtained are reasonably correct only if the substantive specification is adequate. 

these- causal modeling techniques cannot prove causality ; they can help one 
choose between. relevant causal hypotheses by ruling out those not conforming to 
the data. This is the logic of falsification (Popper, 1972). When theories 
are expressed as causal models, they are subject to rejection if contradicted 
by data. 

• C. Spurious Correlation: A Causal Interpretation 

A specific problem which illustrates the importance of careful interpreta- 
tion of the relationships between variables is that of spurious correlation, 
where the association between two variables is entirely due to the influence of 
a common factor. In investigating spurious correlation interest lies in whether 
a relation between two variables (x and y) disappears when a third variable z 
is introduced. The correlation of x and y is spurious if the association of x 
and y is totally due to the causal influence of z. This is illustrated in 
Figure la. To guard against this possibility we might compute the partial 
correlation r between x and y with z held constant. If r is effectively 

* * ^y • ^ 
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zero then this may be the spurious case in Figure»ila. But i*^ is also possible 
that z is a mediating variable in the «true^ relationship of x and y -as illust- 
rated in Figure lb. 



Insert Figure 1 about here 
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Whether an association is spurious or "true/'^(from a causal standpoint) 
cannot be determined on the basis of correlations. Information about the 
causal ordering of the system of variables is required,, which is best derived 
from substantive theory. 

-In Simon* s (1954) classic example, a high negative correlation is found . ^ 

between x, the percentage of a group that is married and y, the average number 

of pounds of candy consumed per month per person. Can we conclude that mar- ; , 

riages causes a reduction in candy consumption? Variable z is the average age 

of members in each of the several groups. However, when age is held constant, 

' the correlation disappears. From common sense the relationship in Figure la is 

" ' ' ^ * ^ " ^ / 

believed to- hoidr the correlation between candy consumption and marital status 

\ ' - ' ' . 

is jointly caused by a variation in age—the relation^ip is spiiifious. This is ^ 

3ut it depends Qn the assumption' that certain ^ 

this ejcample, the decision between models (a) and 

(b) was made by the a ^Rtefi ^assumption thet the age of a person does not 

depend upon marital status or .candy consumption. Here the answer is obvious,/* * 

*) 

but determining causal *or(iering and structure is often treacherous, and exp- 

'I * - 

licit statements of theory are necessary for the unambiguous interpretation of 

* 

t ■ ' ■ 

data. ■ ; . , • 

'Although problems with the causal ordering of variables affect all anal- \- 

" - . i ' " * 

I ysis schemes, a number of otljer characteristics of correlation coefficients 
~7make their use to support claims of causation in non-experimental studies 



a 'common sense* conclusion, 
relations are not causal^^In 



a. Correlation between X and 
^ Y is spurious since the 

association is entirely due 

to the causal influence 

of Z. 



b. The true association 
between X and Y is 

V 

nnediated by Z. 



Figure 1 — Examples of true and spurious correlation- The partial 
correlation r^^y ^ will equal zero in the population in 

both cases. Assumptions about the causal ordering of 
the variables are necessary to differentiate a from b. 
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inappropriate and often misleading. Correlation is a measure of the lineairity 
of a relationship between two variables. Correlation is a descriptive statistic, 
and contains no information about the direction of the association. Thus 
correlations are inappropriate for causal statements. However, many longitud- 
inal investigations report correlations as evidence of causal relationships. 
Lonaitudinal researchers may do well to heed the message of John Tukey (1954) , 
Who in an article on causal models, argued "correlation coefficients are justi- 
fied in two and only two circumstances, when they are regression coefficients, 
or when the measurement of one or both variables on a determinate scale is 
hopeless", (p. 39) 

In the substantiv.e examples to be presented in Sections III and IV, some 
'Of the many pitfalls associated with the use of correlations for causal state- 
ments are illustrated. The. use of regression coefficients solves some of th^ 
problem associated -with the stability of reported effects over differSht-a&npies 
.As Tukey (1954) noted, "We are very sure that the correlation cannot remain Nshe 
same over a wide range of situations, but it is possible that the regression 
coefficients might" (p. 41). The regression coefficients. that possess the 
desired stability are those of structural regression equations. 

III. CONSTRUCTION' OF CAUSAL MODgliS 
The construction of a causal model from a previously published develop- 
mental study^ is presented to clarify the preceding, discussion of their pro- 
perties. Radin (1971, 1974) investigated antecedents of cognitive development 
in lower-class children. Radin was primarily interested' in the effects of ; 
child rearin" practices, maternal behavior in particular. Based on theoretical 
and empirical studies Radin hypothesized that "maternal nurturance would^ footer 
intellectual functioning of the child" (1974, p. 1126). Radin also considered 
evidence "that the motivation o£ the child to achieve is an intervening variable 
in the relationship between maternal behavior and cognitive functioning. 
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Radin's first hypothesis that^matemal nurturance would foster the child's 
intellectual functioning can be represented as a relation between the constructs 

Maternal Behavior and Cognitive Functioning as depicted in Figure 2a. The 
I < 
' arrow leading tc Cognitive Functioning indicates the hypothesized causal influ- 
ence of ^latemal Behavior on Cognitive Functioning • • . 

The consideration of motivation to achieve as a mediating variable can, be 
incorporated into the relationship described in Figure 2a. Figure Zb" 'includes 
the Motivation construct in the postulated causal ordering. The model in 
Figure 2b exhibits tfie two causal paths by which Maternal Behavior may influence 
Cognitive Functioning. • The ^pct path connects Maternal Behavior and Cognitii^e ' 
^. Functioning, and the indirect path involves the Motivation construct as an 
intervening variable. Figure 2b is a representation of, what is termed the, 
- structural model, which expresses the assumed -relations between the unmeasured, 
variables. UnneasuVed or unobserved variables arise when the measurable- varia- 
bles differ from thiir theoretical counterparts. Unmeasured variables often 

7 ■ . ' 

are theoretical constructs ivhich have, implications for determining the relation- 

• ship betivsen observables. Since theory is most often expressed in terms of 
constructs and unmeasured variables, the structural model contains the statement 
of "substantive knowledge to be incorporated into the data analysis. Causal 
models provide the machinery to relate ^theory and hypotheses .expressed in 

■ unmeasured constructs' to observed variables. 

■ Frequently the variables actually measured are theoretically unimportant 

"in their own right, but are taken as indicators of the underlying, theoreti-cally- 

significant coristkicts. As Tukey U954) explained "a prime characteristic of 

quantitative causal theories is. that they include quantitative concepts which 

' . . ' , 

are nbt all subject to direct measurement" Cp- 40). The goal is to make causal 

■ . statements about the unmeasured variables from the observed relations of the 

•^.ndicators. / ' ' 
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Tlie measurement model provides the link between the .constructs and the 
indicators.' Radin measured t^o indicators for each of the constructs m Figure 
2b.- The two indicators of Maternal Behavior were measures of warmth and 
restrictiveness, "obtained during a one hour observation of interaction between 
^ mother and child. The two indicators of motivation were part of the Pupil 

Behavioral Inventory (PBI) and a psychologist's rating of the child's motivation 

m 

■ While taking the Stanford-Binet Intelligence Scale. For Cognitive Functioning 
the two indicators used were the Stanford-Binet and -the Peabody Picture Vocab- 
■ • ulary Test (PPVT) . ' . ^ * 



Insert Figure 2 about here 



Figure. 3 depicts the full causal model, combining the structural and 
, measurement models, of Radin's investigation. ".The symbols &^,&2,&^,S^ through 
6 ) refer to the parameters of. the causal paths which can be estimated from the 
data. In J^igure 3 the e^. represent the part of the observed variable that is 
- not part of the construct it is presi ned to measure. The e. include measurement 
_error and other information irrelevant to the construct.! The e^^ may be thought 
of as the unique part of the ■ jserved variable. Often the ev are assumed to be 

* * * 

uncorrected with each otl}er. In Figure 3 a correlation betv^een e^ and e^ is 
allowed. This correlation is not assumed to be zero because X;^ and X^, measures 
■ of Motivation and Cognitive Functioning respectively, are obtained on. the same 
occasipn, the- administration of the Binet, It is reasonable to expect X^ and 
Xfg.to be related' for reasons additional to the presumed relation between Motiva- 
tion and Cognitive Functioning. The ability to estimate models with correlated 
'errors is an important feature of the estimation techniques for these models 
(See Joreskog 6 Sorbom, 1976a;, and Chapter this volume) . - 
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Q. Representation of the hypothe^zed causal 
effect of Material Behavior on the Cog- 
nitive Functioning of the Child. \ 




b. Representation of the three constructs 
(unnneasured variables) in the p^pstulated 

causal ordering. . , 



Figure 2^ 



l^epresentations of the causal relationship between 
Maternal Behavior '^nd the Cognitive Functioning of 
, the Child. 
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The causal, model is equivalent to a series o£ regression equations with 
t^e same paraketers as in Figure . The structural model is 



The measurement .model is 



. ^6 = Vc^^e 



10 



> Insert Figure 3 about here. ' ; 
*» ^ — , 

From these two sets of equations, relationships 'can be expressed strictly- 
between the observab.les and the unknown parameters. These regression equations 
are called the reduced form. To. estimate the models the constraint =f 63 = 65 = 
1 is introSuced, which constrains X^. to be in the sarfie metric as X^^, "ftc. This 

« * 

constraint "does not effect the generality of the •. anal ysi s . ■ 

It should be noted that th|. usual multiple regression approach is inadequate 
\vhen multiple measures ('indicators) of the same construct are present.. High 
collinearity leads to the problem of the 'bouncing beta weight' and results in 
theoretical nonsense (Gordon, 1968) . . 

In this example the parameters ^2' ^"'^ ^3 '^presenting the causal 
influence between the constructs, are of central interest. The direct influence 
o£ Maternal Behavior on 'Cognitive Functioning is represented by B3. The indirect 
'■ ' effect of Maternal Behavior on Cognitive Functioning,' with Motivation as the 
• . '. mediating variable, is the product of and B^. The importance of Motivation 
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Constructs (unmeasured variables) 



5 . ^6 

IndiCOtOrS (measured variabfes) 



X^~.Mate.rnal Behavior 
X - Motivation of Child 
X^- Cognitive Functioning 
of the Child 



X, - Maternal Warmth 



Xg - Maternal Restrictiveness 
)^3- Motivation (PBI) 
X^ - Motivation during Binet 
Xg - Stanford Binet Score 
Xg-PPVT Score . 



P 



Figure 5 — Complete causal model of Radin's investigation 
with constructs and indicators labeled . ' \ 
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as a midiating variable can thus be gauged by the relative magnitudes of the 
estimates of and 3j> 

Radin^s original analysis (1971, Table 2) did not produce conclusive 
results' on the importance of motivation. In the original analysis, using 
partial correlations between the indicators, all of the indicators could not be 
considered simultaneously. Causal model methods can estimate the relationships 
between the unmeasured variables using all the data at once* A reanalysis 
■ based on the present formulation (Rcgosa, Webb, S Radin, 1976) indicated that 
motivation is a very important, intervening variable for the influence of 
Maternal Behavior on Cognitive Functioning. - 

The process of selecting the variables to be included in the model and 
postulating the causal relationships of the included variables and the residual 
terms constitutes the specification of the model. Mistakes in the specification 
,such as, omitting an important causal variable or incorrectly assuming that a 
causal p^h 'does not exist are termed specification ■ errors . Duncan (1975a) 
suggests t^^at specification .error' "is quite a useful euphemism for what in 
blunter language would be called 'using the' wrong model'. There are many more 
wrong models than right ones, so that specification error is very common, ^ 
though often not recognized and usually not easirly recognizable" (p. 101). 

In the Radin model, at least two measures of each, construct were needed in 
• ■ - ■ • . • . 

"order to estimate the parameters in the model. This is the technical problem 

of identification; a model is identified when all the causal parameters- are . 
Q uniquely fstimable from the data. Underidentification results when there is . 
^ not enough information to estim^ite certain causal Parameters. 

For many constructs used in developmental research a single measure will 
i rarely be sufficient for valid measurement, and thus multiple indicators are 
important for both the technical concerns with identification and for the 
substantive problems of valid measurement. Baltes and Nesselroade (1973) 
-argued: 
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if one wishes to deal with more abstract concepts, such as patterned 
change— change in the interrelationships among a variety of measures— 
then a multivariate approach is necessary. It is from the interrel- 
ationships among measures (e.g., co variances) , so often ignored in 
developmental re search,. that we nay eventually extract the raw mater- 
ial that can be efficiently molded into general, but powerfiil constructs 
to^^id the scientific study of development. A related point i$' that 
when research interest centers on change in more molar behavior . 
patterns such as anxiety and aggression, no single variable can serve 
as a perfect indicator of the target construct. The use of miilti]^ie 
indicators (measures) enables us to form some combination of measures 

. which "locates" the construct more precisely, (p. 222) 

-The choice of multiple indicators is not always desirable, since it 
-indicates the presence of redundant information and not necessarily an increase 
in measurement validity. Detailed discussion of the choice .and interpretatioQ 
of multiple indicators may be found, for example, in chapters 7 and 8 of' Blalock 
(.1974,1 • 

. - ' IV. LONGITUDIKAL PANEL DESIGNS ■ 

One of the most common and useful designs for longitudinal research is the 
longitudinal panel design where the same sample of units, is observed^ at more 
than one point in time. Essentially, panel designs are a combination of time- 
series and cross-sectional designs, with a cross-section (wave) being measured 
' at each time point. Typically, the number of cases in each wave is consider- 
erably greater thah the number of waves. Longitudinal panel designs- are often 
employed to study reciprocal causation, using "longitudinal , (or intertemporal) 
variation to disentangle reciprocal causal effects" (Hannan 6 Young, 1974, p. 
' 2). Hannan S Young presented another use for panel designs: 

* • 
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A closely related motivation for panel analysis arises from work with 
. models containing unobservable variables. Such models Confront 

measurement and other analytic difficulties by inserting into structure 1 
equations models both measured and unmeasured variables. The use of 
unobservables will ordinarily lead to problems of identification 
unless strong restrictions are placed on the model. One possibility 
that occurred to a number of sociologists is to measure the same 
variables at multiple points in time and presume that the causal 

^relations under study are time- invariant. Under a limited number of 

c - - 

* conditions this strategy leads to identification of multi-variable, 
multi-wave panel models containing unobservables. The main point for 
present purposes is that this use of the panel design uses temporal 
variation to eliminate identification prpblems. (p* S) 
The assumption that the pausal relations under study are time invariant 
aeans that, the configurations of the constructs are -assumed identical across 
the different time periods. This is equivalent to an assumption of ''explanatory' 
continuity". ''Explanatory discontinuity occurs when behavioral antecedents or 
mediating processes at one period of development differ from those at "another 

1 Of" 

period" (Huston -Stein 5 Bkltes, in press). In a causal model ojf a longitudinal 
panel, explanatory discontinuity would mean that the causal orderings differ 
among the waves, and a model assuming invariance oyer time would be misspecified 
in some waves. No, assumptions that the causal parameters are invariant over 
time is being made; the parameters are allowed to vary. 

♦ * 

A» Two-Wave Panel Designs ".. . 

The simplest (although not the ideal) panel design is the two wave panel, 
witji observations recorded at two points in time. In the most popular and 
widely discussed two-wave design, two variables are measured at each time point 



and\thu$ the design is termed the two-wave- two-variable^panel (2W2V) . The 
representation of the causal model usually assumed for 2W2V panels is shorn in 
Figure 4* Some important restrictions are built into this model to allow estima- 
tion of the parameters. Most important is the assumption that lagged causation 
is the sole causal force; simultaneous causation between X2 and is ruled 
oiitl Also, the residuals (disturbance terns) u and v are assumed to be independ- 
ent, and the variables must be measured without error. More general models are 
considered by Duncan (il969, 1972) who concluded: 

no set of 2W2V data will answer a question about direction of causal 
influence or relative importance of causes except on some set of 
definite assumptions. If one wishes to avoid assumptions of the type 
illustrated hfere, the only recourse is to expand the study design 
beyong the limits of 2W2V (1969, p. 181). 



Insert Figure 4 about here 



The configuration^ in Figure 4/ can be represented as a regression model: 



h = ^^2^1^ Vl ^ ^ ' ^ \ 

The parameters, 3^, Yj and Y2 are estimable by regression, and the esti- 
mated causal effects are easily interpreted, \^hen the restrictions of the model 

> 

are satisfied. 

A research example of the use of the 2512V design is the investigation of 
Crano, Kenny, and Campbell (1972) concerning the causal relationship between^ 
intelligence and achievement. The substantive background for the sUxdy was 
that: 

The literature of cognitive development has produced two opposing v 
models of ©ental growth. One holds that the acquisition of concrete 
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Figure 4 — Representation of the causal model for 

2W2VJpanel. Assumptions built into this 
r model are no simultaneous causation, 

measurements without error and uncorrelated 
residuals . 
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mental skills causes the later development of higher order organiza- 
"tionai schema or rules. The contrasting model postulates a progres- 
sion in which the initpl acquisition of larger schema results in the 
increased capacity to acquire new concrete skills, i^hile both probably 
^ "derate to some extent, an attempt was made in this research to 

, determine the preponderant developmental sequenc\. (p» 258). 

The research question was; ^ \ 

Does the acquisition of specific skills 'or the leaiJping of specific 
information (Achievement) result in an increased ability for abst- 
raction (intelligence) , or is- the progression more accurately describ- 
ed as one in vjhich intelligence causes achievement, that is, doeS the 
greater abiliiy to form abstractions result in a greater amount of 
concrete infor|iation being absorbed and retained? (p» 258-259) 
The research design consisted of measurements of intelligence and achievement 
at two points in time. The data are intelligence (Lorge-Thomdike) and achieve- 
Bent (Iowa Basic Skills)! test scores of children attending the fourth grade in 
■ the academic year 1963-4 and the same tests given two years later to thfe same 
students. If the requiifed assumptions were made, the data can be entered into 
the model of Figure 4 /with X as Intelligence and Y as Achievement) , and the 
causal parameters, estimated. Crano et al. did not perform a causal model^ 
analysis of their 2W2V data, but instead enployed the method of cross-lagged 
correlations discussed below. ' ' . ^ 

In the education and psychological literature, much attention has been 
fiven to cross-lagged correlations as a means for inferring the -direction of 

causal influence. In Figure 4 the cross-lagged correlations are rj^ y and 

1 2 

r If r > Y suggested interpretation (Campbell, 1963) is that 

^1^2' ^1^2 ^1^2 

. - X causes X. Although the cross-lagged procedure has come under sharp attack 

(Duncan 1969, Goldberger 1971) its use is still widely recommended (e.g., 
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swart 1.975; 1975; Huston-Stein § Baltes, in press). Goldberger charged 



Clarke-Stewart 

/ that the justification of the cross-lagged correlation method is based not on 

•'evidence but on "intuition, huncn, and plausibility, which are hardly persua- 

* sive" (1971-, p. 102) A superior method for inferring the direction of causal 

influence is to "estimate the parameters .of' the causal mo4el (Figure 4) which 

have direct interpretation.! . \ " 

^ The cross-lagged correlations are a complicated function of the causal 

i' ■ ' . ■ ' .J 

parameters & , B , Y > Y -x It is easy to construct cases where cross-lagged 

. 1 2 1 2 \ . _ t ; 

correlations give exactly tk^ wrong answer; that is lead to the inference that 
the direction, of causality is opposite to that in the underlying model. For 
/v example iii the causal 'model (Figure 4)) let all variables' have unit variance and 

* let the true values of the causal parameters^ be B => 0.9, B, = 0.3, Y,= Q*l* 

, 1 2 X ^ ► • 

■y" = 0, and r„ Y = 0.6. Thus the underlying causal influence over time is in 
2 . - ■ Vl ' • - .- ^ 

«f the dir,ection "of X causes, Y. The cross-lagged correlations are y '^^ 

.r - '= -.54, and the conclusion would be that Y causes X. This example is not 

, i. ' - ^1^2 ' . 

just 4 mathematical aberration; large differences in stability of the two 

measures are common, for example, in research on mother-child interactions (see 
darker Stewart? 1^75) and will cause the cross-lagged analysis to break down. 
Estimation of the underlying causal model is^ preferred to developing a special 
theory of cross -lagged "correlations . ' 
•B. Complications in 2W2V model ^ ' ' ^ 

As Puncan (1972) sagely observed, it is unreasonable to expect "that in 
panel analysis the usual obstacles to inference and estimation are suspended 
for the benefit of the analyst" (p. 37). Two major obstacles are measurement 
r error and specification error. Their consequences for analysis are discussed 
below in the context .of the 2W2V design. Tlie consequences of violation of 
assumption and the consideration of alternative models is, applicable to all 

• causal models. 
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A 2W2V model with measurement error is shown in Figure 5'- The causal 
' influences are presumed to be transmitted through the true scores X*^ Y* which 
are unmeasured. Because additional parameters must be included in the model to 
represent .tie 'measurement error there is no longer enough information from the 
observables to estimat:e the causal paths, and the model is underidentified. The 
problems with cross-lagged correlations are naturally increased when the varia- 
bles are measured with^error. Wiley and Homik (1973) argued cogently against 

their use: ^ 

Comparison of cross-lagged panel correlations was the first widely 
■kl . advocated non-experimental technique for the attribution of causality 

to quantitatively scaled variables in social-psychological research. 
/V In addition to the lack of a clearly stated statistical model, one 

universally reqognized .weakness of this technique is its serious 
distortion by commonly occurring measurement errors. One especially 
distorting event is systematic change in the reliability of variables 
over time. Such events occur, for example, when a true variable's 
variance changes, although the quality of the measurement remains the 
same. This is nearly always the cas^^. when any change in a true 
- variable takes place (Wiley 5 Wiley, 1970)- Thei^efgre, it is 
difficult to justify the .use of [this] technique in typical social 
research settings, (p-2) 



Insert Figure 5 about here 

ki - 
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Figure 5 Representation of a 2W2V design with measurement 
error. In addition to the previous Assumptions 
for 2W2V panels the measurement errors (ap are 

assumed uncorrelated, Howeyeif^^ the causal param- 
eters of interest g^, Ti> ^^2'' which represent 

the causal influences between the unmeasured true 
scares, cannot be estimated without additional - 
information. 
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If independent estimates of the reliabilities are not available, the 
additional information needed to estimate the model may be obtained by t\vo 
strategies: increasing the number of measures of each variable at each point 
(Wiley §jHomik, 1973) or increasing the number of t.ime points to three (Heise, 
■ 1969). IVil^y and Homik (1973) explain the use of duplicate measures represent- 
ed' Figure 6: ' 

We suggest expanding the number of measures of each variable at each 
point. Tvip/ measures of each variable at each time point produce 
enouc^h additional information to allow the calculation of all the 

> ■ 

quantities in a quite general two-time point model, (p. 8), 



Insert Figure 6 about here . 



■ Specification error occurs when the postulated causal model is an incorrect 

representation of the actual (psychological) process. A commonly considered 

form of specification error in panel analysis is the existence of a common 

factor .causing both the X and Y variables (Duncan 1972; Kenny, 1973) . Duncan 

' presents many examples of specification errors due to omitted causal influences 

and correlated errors. Clearly, numerous ways exist for assumptions to be 

violated. One example presented by Duncan (1972, p. 56) is adapted as Figure 

• ' 7. The data reported by Jbreskog (1975a, see also Chapter this volume) are 
}■ . . " . ■ » - ■ • . ■ 

test results in mathematics* and science taken in the fifth and seventh grade. 

It may be reasonable to posit that a common factor (F) is the sole causal 

agent-; the observed test scores are related only through the common ca^use-. An 

analysis based on the model in Figure 4 when the model in Figure 7 is. the 

■ t ' ■. 

corrdct-oDe will yield misleading results. Many other plausible forms of 
specifacation error in longitudinal panel models are considered in Duncan 
(1972, 1975a) and Joreskog and Sorbom (1976a). 
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Insert Figure 7 about here 



Multiple Wave Panel Designs ^ . ^' < « 

In developmental research, more than two waves of observations are usually 
desired on substantive grounds, ^fultiple waves have the added advantage that, 
they allow estimation of parameters under less restrictive assumptions (Hannan, 
• Ruhinson § Warren^ 1974 J. However, as might he expected,, multiple waves of 
'observations make model specification and estimation more complex* To illus- ^ 
trate the use of pjanel designs, two studies. in which the investigators attempt- « 
ed to make causal statements from longitudinal data are; formulated. as causal 
models. The original analyses are discussed so as to point out the advantages 
of, causal models in design and analysis. > \ • 

Clarke-Stewart (1973) collected data on 36 mother-child dyads over a nine- 

■ > f * * 

month period, tracing the children from age nine months to 18 months. Repeated 

- observations of the mother-child dyads ,were made both in natural settings (the 
home) and in a variety of standardized or semistructured , (test and laboratory) 
situations. Clarke-Stewart began her longitudinal study by identifying as one 
of; the problems of aethod in child, development, research that "in the past, ^ 
studies have seldom been longitudinal in dasign, a^d when longitudinal, mat- 
emal behavior' has often been measured at one time and infant performance at • '^;t 

■ another, "consequently not permitting the analysis of causal relationships" (p. . * 
,8) . Since the mother-child interaction is certainly an instance of reciprocal 
causation, longitudinal designs may allow the untangling of the reciprocal 

causal influences. ' ^ 

The portion of the total data which Clarke -Stewart used to make causal 
.inferences (see 1973, pp. 82-91) corresponds to a three wave longitudinal panel 

with waves at the child ages of 11, 14, and 17 months. Most of the attanpts at ■ ■ ^. 

. ■ • '■ ■ ". 
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An alternative causal structure for the 2W2V 
design. All the causal influence is carried 
by the common factor F. 
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causal explanation used data from only the first W third waves. ,For all 
causal statements Clarke-Stewart used the nethod of cross- lagged correlations. 
One instance in which she considerld all three waves is illustrated in Figure 8 
where the causal influences of maternal . attention and the child's attachment to 
the mother are examined. A^s can be seen in Figure 8, Clarke-Stewart considered 
the three waves- of data as two two-wave pieces. *The somewhat ambiguous causal 
conclusion drawn from the two sets of cross-lagged correlations is 1 

- At Times 1 and 2 the ctoss-lagged correlations for ihfant^attachment 
and material attention suggested that maternal attention was causing 
..an increase in infant attachment. From Time 2 to Tim^ 3 howeyer, the 
■ cross-lagged correlations implied the opposite: that infant attach- 

ment was causing maternal attention. Jhis finding suggests the 
possibility that, as mother and child search for hamonious, balanced --^ 
. interaction oyer the course of development, first one then the other, 
assumes the "causal role" . (p. '91) 



Insert Figure 8 about here 



A causal mddel of the 3W2V panel is shown in Figure 9. The. panel model in 
Figure 9' allows doubly lagged causation between waves one and three between 
; va^iables but not within- variables. Labouvie (1974) wou.d term this- model a 
between-domain distal-within domain proximal mbdel. A causal model analysis of 
-these three-wave data is certainly more attractive since it would use all the 
. data at orice a^, opposed to breaking the longitudinal data into two separate two 
. wave- sequences. Also it might be expected that analyzing all three time 
periods at once would alter the original conclusions, especially if there were 
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Mt = Maternal Attention to Child at Time T 
Ct = Child's Attachment to Mother at Time T ^ 



Figure 8— The 2W2V configuration, with the cross-lagged ^ 
and synchronous correlation exhibited, of a - 
three wave design.. (Adapted from Clarke - 
■ Stewart, 1973). . f , 
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any appreciable direct causal effect between wave one apd ^ave three/represented 
by and in Figure 9. 

Insert Figure 9 about here 

— , r ^« 6 

' 0»Mally and Bachman (1876) reported an eight year longitudinal study in 
which the relationship between self-esteem and success was investigated. Measures 
of self-esteem were collected at five points in time on 1600 young men over an 
eight year period (l966-197-4)-beginning when the subjects entered tenth grade ~ 
through five years after graduation. Success was measured once, by level of 
occupational and educational attainment in 1974. Many other variables were 
measured across some or all of the five waves: status of aspired occupation at 
all. waves, grades at the first three waves, and background measures, of 'ability 
and SES ,a^- the first wave. The design was not strictly a longitudinal panel 
since the major outcome variable, success, was only measured at the final'wave. 
" Therefore, -the reciprocal relationship between self-esteem and success (attain- 
ment) may be difficult- to unravel. - . . * . 

O'Mally and Bachman distinguish three logically independent patterns of 
causation between self-esteem and attainment: (a) that self-esteem contributes 
directly to attainment; (b) that attainment contributes, both indirectly and 
directly, to heightened self-esteem; and (c) that some of the underlying 
determinants of self-esteem are also important determinants of attainment 
(•e.g.,' academic ability, past educational accomplishments and family socioe- 
conomic level) . , , 

These three patterns of causation, which may be responsible for the 
abservad relations between self-esteem and success, can be represented: 
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Fieure 9 -- The 3W2V design of Clarke-Stewart .{1973) with • 

the causal parameters and structural regression 

equations shown. The X variables are Maternal 
. • Attention to 'the Child and the Y variables are 
the Child's Attachment to the Mother. 
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(a) Self- Attainment 

■ esteem *' • ^ _ 

^ , . (b) Attainment > Self-esteem 

(c) Background ^^^^^^^ Attainment 

Variables ^s^^ 
b ■ ~ Self-esteem 

i . ■ " ' ■ 

' The analysis of these causal sequences is based entirely on correlations. 

^o illustrate some of the problems with the analysis, consider the correlational 

>■ anal'ysjs O'Mally and Bachman '(1976) proposed for the second suggested causal 

.■ sequence, that attainiscnt (th6ir B). causes self-esteem (A). Two of their 

♦ 

pertinent hypothses were: 

• Hypothesis 2a^ Later self-esteem is positively correlated with 

-.attainment, after statistically controlling background and ability 
and also earlier self-esteem (based only on B causes A). 
Hypothesis '3. Attainment (five years after high school) is more strongly 
correlated with later self-esteem than with earlier self-esteem. This 
. . ' hypothesis is based on B causes A . (p. 8) 

Figure 10 represents a causal model of the relationship of self-esteem and 
- attainment, relevant to the above hypotheses. ' 



Insert Figure 10 about here 



Figure 10 shows that the O'Mally and Bachman hypothesis that B causes A is 
equivalent to postulating a.nonzero value of y. However, a positive -value of 

e would cause the correlation between self-esteem at time point 5 and at-' ' 
5 

tainmeht, with earlior self-esteem held constant, to be positive even when 
Y is zero. Therefore Hypothesis 2a is not "based only on B causes A." By the 
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A causal model of esteem and attaiiinu^t patterned after 
the O'Mally and Bachman (1976) data, ^X^tiixottgh-^t^ 

self-esteem at the five time points • Y* is the attainment 
(success) construct with indicators Y = educational 
attainment, Y^ = occupational attainment. The causal 

paths and^parameters of the causal relations are shown* 
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same logic, if '3^, Sj* B^, 'S^ .were zero in Figure 10, then ^ attainment would be 
more strongly correlated with later self-esteem (Xg) than with earlier self- 
t esteem for any nonzero values of y and 3-. Hypothesis 3, then, is also not 
properly tested when correlations are used in place of estimation of The 
correlations confound the effects of a nopzero y with other causal configura- 
tions. Because plausible alternative explanations exist for the correlations 
that O^Mally and Bachnan posit as proof of their causal hypotheses. Hypotheses 
5a and 3 are not logically sound representations of the causal structure. 

In addition to the previously discussed problems with correlations as a 
measure of causation, there are important ones associated with standardization 
Wiley 5 iViley (1970) and Tukey (19S4) among others ^vamed against using standard- 
ized measures for causal statements. It is unreasonable to expect variances to 
rjemain constant over time; in fact the increase over time of interindividual 
differences in development implies an increase in variance. But a change in 
the variance of, say, self-esteem changes. the correlation without necessarily, 
affecting* the strength of the relationship. n 

'Furthermore, aside from the inadequacies of correlations in this coT:text, 
without repeated measures 'of attainment over the waves of olservaticns, O'Mally 
-and Bachman are not able to disentangle, unambiguously the rev:iprocal causation 
between self-esteem and attainment. Perhaps grades could have been u-^ed as a* 
proxy for attainment .in the earlier waves, in order to evaluate causal influenc- 
es from the available data. 
D, Distal Causation ahef Causal Lag 

The Questiorf of the proper degree of causal lag has frequently appeared in. 
the causal models that "have been considered. For example, in the 2W2V model's 
simultaneous causation *was ruled out; consequently, the proper causal lag was 
assumed to begone time pe^riod (see Figure 4)'. In multiwave models such as 
Figure 9 (Clarke-Stewart "^s '3W2V design), a variety of causal lag patterns are 
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possible.., There may be direct effects from time 1 to time 3 both ^within and 
between the variables, in addition to simultaneous effects. In the O'Mally and 
?achman example, a number of different indirect and direct causal lag patterns 

are possible. , 

A major concern of life-span^psychology is establishing long-term causal 
relations. "Sinc^ life-^pan research deals. most "explicitly with the analysis 
of long-term phenomena and chains, it has been forced to attend to the issue of 
Structuring time-lagged relationships and performing distal-cause analyses 
CHuston-Stein 5 Bcltes. in .press, p. 11). Often 'the results of the causal 
model ^analysis of the time-lagged relationships depend on the kinds o£ causal 
*^lags built into the model. Unfortunately, developmental theories which would 
be ther best guide to the proper kinds of causal_,lags to incorporate in the 
model offer little guidance in post situations. The majority of longitudinal 
panel models postulate single .period causal lags or equal lags across multiple 
..waves. An l^xception is an analysis by Hannan et al. (1974) whose 3W2V model 
■has. a two-wave causal lag in one direction, and a one-wave lag in the other 
direction. 

"■ V. SUMMARY 

This chapter has involved consideration of some methods for making causal 
statements in developmental research. In the study of development and growth, 
longitudinal designs should be used. ' Cross -sectional designs will give conflict 
ing (and misleading) evidence over replications, and can yield little informat- 
ion dn the causal dynamics .of development. From practical necessity and for 
^ecological validity the longitudinal designs will often be nonexperimental and 
naturalistic. Additional knowledge from substantive theory and empirical 
evidence may be profitably incorporated into the data analysis of such designs 
through the^ use of causal models. ' . 
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Causal models are presented as an attractive'^^vehicle for the formulation 
of well-specified theory in an empirically testable form* The construc^tion of 
causal models is a two-stage procedure involving the structural model which 
specifies the relations between the tKeoretically important constructs and the 
measurement model which relates' unobserved constructs to their observable 

measures* The construction of a causal model from a substantive, study illust- 

* ** * 

rates the usefulness of multiple measures of constructs in' the estimation of 

causal effects. , - 

Longitudinal panel designs combine features of cross-sectional and time 

series designs in that waves of cross-sections, containing the s^me sampling 

units, are measured at two or mpre time points. A strong feature of panel 

designs is their ability, in certain situations, to separate reciprocal causal 

influences between two or more variables, which is in general impossible with 

cross^sectional data. The two-wave two-variable (2W2V) design has been widely 

used for this purpose. A formulation of the 2W2V design as a causal model 

reveals that highly Restrictive assumptions are necessary for estimation of 

causal influences and for the desired determination of which variable causes 

V 

the other. The popular method of cross-Jagged correlations is, shown to be 
undesirable; direct estimation of the relevant causal pa;ramete'rs is always 
preferable. 

Two major technical problems associated with causal models (and with ^ 
almost all analysis techniques) are measurement error and specification error. 
However, multiple indicators of the fallibly measured constructs may, in many 
instances, allow unbiased estimation of the model. Specification errors arise 
most often when' important causal variables are omitted from the model and cause 
the estimates of the causal influences between the included parameters to be 
biased. Some common forms of these two obstacles to estimation are ^illustrated 
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" , for the 2W2V design. Technical issues %n estimation are treat^ed in another 

chapter. * . 

The more powerful multiwave panel designs are described" by formulating 
causal liiodels from two substantive longitudinal studies. The use of correla- 
tions in these studies to support causal statements is criticized- ^ 

Causal models specify on an a priori basis how the^ same correlations might 
have arisen from a variety of- causal mechanisms. The value 'of , causal models, 
^ then, lies in their incorporation of subs Untiv ^theory and reduced dependence 



on post hoc interpretation of correlational data, 
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ABSTRACT 



' " This*' chapter deal^ with statistical methodological problems in the 
analysis of data from^large longitudinal studies where the same or 
similar quantitative measurements have been obtained at two or more 
occasions, possibly from several different groups of people, Seve;ral 
(^models are developed for a wide range of applications for psychological 
and educational measurements. The,,problems of model speliification, 
statistical identification, estimation and testing are discussed. In. 
particular? the chapter focuses on the following problems: (i) th;^ 
estimation of growth curves under auto -regressive models; (ii) the 
treatment of measurement errors in observed variables; and (iii) the 
scaling of lament variables- Several examples are given illusttating 

the assessment of fit of a model and data-analytic strategies for 

** 

.» < 
model modification. ^ 
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I . Introduction 



The characteristic feature of a longitudinal .research design 
is that the same measurements are obtained from the same people at 
S.two or more occasions. The-purpose of a longitudinal or panel 
study is to assess the changes that occur between the occasions 
and to attribute these changes to certain background characteristics 
an4^ events existing or occurring before the first occasion and/or to 
various treatments and developments that occur after the first 
occasion. A schematic illustration of a two-wave longitudinal design 
is given in Fig, 1. Earlier* chapters of this volume have dealt with 
thQ conceptual and substantive issues and with the logic of^ causal 
modei building in longitudinal, research in developmental psychology 
and education. Other chapters have dealt with specific jnethodological 
problems. Wiley and Harnischfeger (1973) have given an account of the 
conceptual issues in the attribution of change in educational studies. 
' In the sociological literature there has been a number of articles 
concerned with the specification of models incorporating causation and 
measurement errors and the analysis of data from panel studies -(see 
e.g. Bohrnstedt,, 1969; Heise>^ 1969, 1970; Duncan, 1969, 1972,' 1975b) . 
Other papers dealing with methodological problems are Lord (1963), 
Thorndike (1966), HHrnqvist (1968), Cronbach and Furby (1970) and 
' Bergman (1971). Complex models involving multiple measurements and/or 
several occasions have been considered by Harris (1963), J5reskog . Cl970a) , 
Corballis and, Traub (1970), Nesselroade (1972), Corballis (1973), 
Bentler (1973) , Frederiksen (1974), Jlireskog and Sorbora (1976a-b) 
and Olsson and Bergman (1977) . 



Insert Figure 1 about here 
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Figure 1^ — Schematic "representartioh of a two-wave longitudinal design. 
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In this paper we consider several models suitable for analyzing 
longitudinal data and deal with problems of model specification an4 
statistical- identification, estimation and testing. The general 
setup is. that of a longitudinal study where the same or, similar 
quantitative measurements have been obtained at two or more occasions, 
possibly from^ several different groups of pteople. The models cover 
a wide range 6f applications and are relevant for psychological and 
educational measurements as well as for social and socio-economic 
measurements. 

Section III considers the measurement and assessment ^of change 
at the group level. It derls with the estimation of growth curyes^ 



describing She means of the variables as functions of time. This 
section also considers various auto-regressive or first-order Markov 
models that occur naturally in repeated measurements. In this section 
we treat the variables as errorfree. 

One of the most difficult problems for a social scientist, when 
it comes to the formulation of a causal model, arises because many of 
the concepts and constructs that he/she wants to work with are not 



"directly measurable (see e.g. Torgerson, 19b8, Chapter 1, Goldberger, 
1972, Duncan 1975a, and Heise 1975), Although such hypothetical 
concepts and constructs, or latent variables, as we shall call 
then, cannot be directly measured, a number of variables 
can be' used to measure various aspects of these latent 



\ 
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variables more or .l^ss accurately. Tlius, while the latent variables 
cannot be directly observed, they have operational implications for 
relationships among obsierved variables. We may regard the observed 
variables as indicators of the latent variables. Each indicator 
has a re]Lationship with the latent variable, but if we take one 
indicator alone to measure the latent variable we would obtain a 
biased measurement. By using several in^dicators of each latent 

variable we get a better measurement of the latent variable . 

■ • ' - . \ ' 

Another reason for using latent variables in behavioral and socioeconomic ' 

studies .is .that.most of the measurements employed contain sizeable 

errors of measurement (observational errors) which, if not taken 

'into account, can cause^ severe bias in the results. Errors of 

measurement arise because of imper.fection in the various measurement 

instruments (questionnaires, tests, etc.), that are used to measure 

such , abstractions as people's behavior, attitudes, feelings and • 

motivations. Even if we could construct valid measurements of thes,e it 

is usually impossible to obtain perfectly reliable variables. Special 

care must be taken to obtain measurements that really measure the 

latent traits or hypothetical constructs that one is interested in 

measuritig. Various models with latent variables are considered in 

sections IV for two-wave situations and in section V for multi-wave 

situations, 

. A common experience in two-wave longitudinal studies, is that the 
initial status is the best determinant or predictor of the final 
status (see e.g. Lord^ 1963). Therefore, if one is interested in 
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-attributing change to certain background variables one must find ^ 

some way o£ effectively eliminating the initial status from the ^ S 

final status. This has been taken to mean that one should study , ' 

difference scores (final scores minus initial scores)* However, 

this is not necossaiy; the important thing is that both background 

vaFiables and initial measures are included in the model as ' 

determinants of final measures. In multi-wave studies one can 

' ^ " * • / • 

; determine the effect of the background variables on the dependent / 

/ 

variable at various points, in time. Most of the models introduced / 
in sections IV and V are considered both with and without background, 
variables'. ^ " , « 

Often it is not possible, or even desirable, to specify the 
model completely since there may ^e other models which are equally 
plausible. In ^uch a situation it is necessary to have a technique 
of analysis which will give information about which of a number of 
alternative models is (are) the most reasonable. Also, if there is 
sufficient evidence to reject a given model due to poor fit to the 
data, the technique should be such a*j to suggest which part of the 
model is causing the poor fit-. Several examples will be 
given illustrating the assessment of fit of a model and 

strategies for model modification. ' 
* In presenting the various models it is convenient to use a path 

diagram. In this path- diagram observed variables are enclosed in^ 
squares whereas latent variables are enclosed in circles. Residuals 




(errors in equations) and errors of measurements aire included in 
the diagram but are not enclosed • A one-way arrow pointing from one 

Ik 

variable x to another variable y indicates a possible direct * 
causal influence of x on y , whereas a curved two-way arrow be- 
tween X and y indicates that x and y^ may correlate without 
any causal interpretation of this correlation being-given. It is 
convenient to write the coefficient associated with each arrow in the , 
path diagram* IVhen the coefficient is omitted it means that ^ it is 
one. For one-way arrows such coefficients will be (partial) regression 
coefficients (path coefficients) and for two-way arrows they will be 
covarianccs. In the special case when all observed and latent variables 
are standardized, these coefficients will be correlations. With these 
conventions it is possible to write down the model equations from the 
path diagram. In order to define the model completely it is only 

necessary to specify the assumptions about the origin and unit of 

♦ 

measurement of the variables involved and the distributional assumptions, 
if any, 

5^ 
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' • . ■ IL. Computer Programs 
. All 'the models ^considered in this chapter may be estimated by - 
means^of three computer programs: ACOVSM by JOreskog, van.Thillo 
and Gruvaeus (1970), "LISREL by JOreskog and S»rbora (1976c)and 
COFAW by SOrbora and Jx*reskog (1976)/ The general models ^n 
which these programs are based are described briefly here for 
future reference. F&r each model introduced in later sections of 
this chapter it will be sh9wn how this is a special case of one 
of the models presented here. ^ ' 

A, ACOVSM . . " * 

The ACOVSM model considers a data matrix X(N x p) of N .observa- 
tions on p variables and assumes that the rows of X are independently^ 
distributed, eacli having a multivariate normal distribution "with" the 
same variance-covariance matrix Z, It is assumed that 



ECX) = A5P, 



(1) 



where A(N x g) = (a^^) and P(h x p) = (p^j) are known matrices of 
ranks g and h, respectively, g 1 N, h <.p, and J(g x h) = (C^^) is 
a matrix of parameter;; and that Z has the form 



Z = B(A«A' + ^^)r * 0^, (2) 



whore the matrices B(p x q) = (6.^), ACq x r) = (Xj, the symmetric 
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matrix- *(r x r) = i^^^), and the diagonal matrices VCq x q) =^ C^jl'i^) 

and. 0(p.xp) = (6^.6.) are parameter matrices. 6.^ denotes the 
Kronecker delta, which is one i£ i' = j and zero otherwise. 
^. Thus the general model is one where means, variances., and 
covariances are structured in terras of other sets of parameters that 
are to be estimated. In any application of this model, p, N, and X 
will be given by the data, and g, h, q, r. A, and P will be given by 
the particular application. In the special case when both H and 
Z are unconstrained* one, may test a sequence of linear hypotheses 
of the form 



CHD = 0 , 



• C3) 



where C(s x g) and DCh x t) are given matrices of ranks s and t, 

respectively. >^ 

For further information about the ACOVSM model and its uses see 

Jbreskog (If 70c, 197ob) . ' \ 

B, LISREL ■ . • . ' 

The LISREL model considers 'random vectors n' = (n^, n2i---> \) 
and 'V= (Cj, V °^ latent dependent and independent variables 

respectively, and the following system of linear structural relations 



Bn = rc + ? 



(4) 



where B(ra x m) and r(m x n) are coefficient matrices and 



= (Cj, •*''^m^ ^ random vector of residuals (errors in 
equations, random disturbance terms). WithJLt loss of generality 
it may be assumed that E(n) = E(c) = 0 and E(5) = 0. It is- 
furthermore assumed that 5 is uncorrelated with 5 and that B 
is nonsingular. 

The vectors X n and 5 are not observed but instead vectors 
r " '^^l' ^2' ••"V " ^^1' ^2' ••"V observed, such 



that 



y = A^n + e > • (5) 



X = A 5 + 5 , • * ^ . (6) 



where e and 6 are vectors of errors' of measurement in y and 
respectively, y and x are assumed to be measured as deviations from 
their means. The matrices' A^fp x c) and A (q x n) are regression 

-y : , 

matrices of y ' on n 'and of '^x on 5> respectively. -It is-conr 
. venient to^ refer to y and x as the observe'd variables and' n and 
£ as the latent variables. The errors of measurement are assumed to 
be uncorrelated with the latent variables. ' 

Let ^ (n X n) and ?(m x m) be the covariance matrices of C 
and C , respectively, and let^%e^ and 6^ be the covariance matrices 
of e and 6, respectively. Then it follows, from-- the above .assumption, 
that the covariance matrix E[(p +^ ql x (p + q)] of z = (y",x')' is 
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The elements of E are functions of the elements of A^, A^, B, 
r, 0^ and 0 . In applications some of these ^elements are 
fixed and equal to assigned A^alues.., in particular,, thi^ is so for 
elements ii A ^ A , B and There is^ no requirement that m<p, n<q 
^and that 0 'and 0. be diagonal as in traditional factor analysis. , 

^ -^ • / " . , 

The only requirement is that -E in (7) iSKnonsingular, and-^thaf- the 

model is identified (see section II,E); • ' ' 

» ' - 

There are several options avairable to -the us&t to choose various 

'Special cases of the general m(idel. Probably the taost important or 

these options is the "n6 xV <Jption, I'.e., ^ the "specification or 

a model in- which theij-e is no ^x. , then, the whol^e■ equation (6) is 

missing, so there is no 6, A^, * and 0^. In^ tHis ,case, equation (t 

should be interpreted as ^ ^ 

* • *► . 

Then the only vector of observed variables is y anci the covariancc , 

matrix of y^Hfex p), is . * . 

4^ ' -1 -1 

.y. .y 



The only parameter matrices are Ay, P, V and 0^. 
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The measurement model pai:t o£ the general model, as given by 
(5) and (6), specifies how the latent variables 

• are measureS in terms of the observed variables. This is 
used to describe the measurement properties (reliabilities and validi- 
ties)" of the observed variables. The structural equation, model part 
of the general model, as given by (4)-, specifies the causal relation- ' 
^ships assumed to hpld among the latent variables. This is used to 
describe an^i'assess the causal effects and to estimate the amount of 
unexplained variance in the dependent variables. In order to assess 
the causal -effects it is necessary that the units ^of measurement^ in the 
latent variables be defined in 'a natural way. This can often be 
done by specifying the unit of measurement to be the same as in one 
of the observed variables. For further information, about .LISREL 
and its uses, see. JOreskog (1973 a, .1976) and JtJreskog and SBrbom^ 
(I976a-c) . • • 

C. COFAMM •• « • ' ' 

The COFAMM mbdel assumes that we have measurements, from several 
; independent groups of individuals possibly with different. mean vectors 
■ and covariance miitrices. It is assumed that p variables have been 
. measured in a randojn js ample of individuals from .each population. 

Let z be a vector of order p, representing the measurements 
obtained in group g; g=l,2,..., G. We regard Zg as a random vector 

withnnean vector' u and covariance matrix E^. It is assumed that a 
Tg ' . . ' 

factor analysis'model holds in each population so that , z can be accounted 

for by Ic- common factors ^ and p unique factors or residuals qZ,, as 
« , * -g '^^ , 

z=v+Af+ei - ' '^^^ 

h -g -g-g !g - . . ■ 

• 3.43 

.321 



where' v is a pjd vector of location parameters and a pxk 

parameter matrix of factor loadings. It is assumed that E(eg) = 0 
and E(f ) = 0 , a kxl parameter vector and that e^ and f^ are 
uncorrelated. Tnese assumptions imply that the mean vector ^ of. ■ 



9 . IS 



y = V + A„e„ 
-g -g -g-g 



and that the covariance matrix of is 



E = A * A' + 1'„ 
-g -g-g-g -g 



(10) 



(11) 



where * ^ is the covariance matrix of f^ and is the- covariance 

- . ~ ■ '( , ^ 

matrix of e ■ 

Concerning the specification of parameters and there 

are several options. The most important of these is the specification 
of invariance over groups, i.e. - 





- V2 = . 






h 


= A2 = . 


• * ~ -G* 





This makes it possible to estimate the 6^, g=l,2,..., G on a 

comiTion scale. For further information about COFAMM and its uses, see 

Jbreskog (1971), SBrbom (1974) and SOrbom and JOreskog (19?6) . . 

D. Fixed, free and constrained parameters 

— — — • 

In all three models and computer programs, some elements of any parameter 

matrix may be fixed and equal to assigned va;ues. For rthe remaining nonfixed 

elements of the 



■■i 



,7 



"p^ameter matrices one or more subsets may have identical but 
unknown values. Thus each element in any parameter matrix may be: 

V (i) a fixed parameter that has been assigned a given value, 
Li) a constrained parametefr that is unkno\vn but equal to 
one or more other parameters or 
, (iii) \a free parameter that is unknovn and not consl^ained to • 
be equal to any other pai;;ameter. ^ J 
This results in^^great generality and flexibility in that many different 
. kinds of models may be handled. The three models and the progr^is 

cover a wide range of applications. in the behavioral and social sciences. 
^ E. Identification of parameters ^ 

The <^eneral models described here and those that will be considered 
in later sections of this chapter are all of. the following form. The 
distribution .of the observed variables is multivariate with mean 
"vector p(e) and covariance matrix E(e) both being functions of 
parameters 9'= (6^, Q^, 6^) which<,are to be estimated from 

data, 'ht is assumed that the distribution of the observed variables 

is sufficiently well described by. the moments of first and second 

^/ . 

ord^r. i.e. by the mean vector p and the covariance matrix E, so that 

II '■ 

ii)form9tion about" 0 contained ia moments of higher order than the second - 
may be ignored. In particular, this will hold if the distribution is 
multivariate normal. , . » . 

In general the parameters in 0 may be of three kinds 
(i) those that are involved in both y and Z 
(ii) those that are involved in p only, 
(iii) those that are involved in Z only. 
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Let 8j, ^2 ®3 be, vectors with these' three t^pes of 

parameters, so that .9' = (Bj^, S.^X^p- A' special case is when 

. is empty as in ACOVSM and LISRED^ A further special case is 
'when 8 J is empty and the transformation 11(82) is one-torone as in 
LISREL. Then the mean vector p is unconstrained and the only, 
restriction is on E . Another special case is when 8^ is 
empty and the transformation 1(93) one-to-one. Then E is un- 
constrained and the only restriction is oa ]ir ^ 
Before an attempt is made to estimate the parameters 8 ^ the 
- " identification problem must be resolved. The model is said to be 

identified if ^ ^2 ^"^P^^®^ ^^^^ [i!^?2^' 

i.e., (if (y ,X) is gejnerated by one and only one 9 , However, 
even if the whole model is not identified some parameters in 9 
, can still be identi'ked. Consider the set 0 of all 9 generating" 

\ 

the same (y,E). If a parameter 8^ has the same value in all. vectors 
' 8 eOthen 8^ is said to be identified. For parameters which are 
identified it is usually possible to find consistent estimators. 
If a model is not completely identified, restrictions must be imposed 
on 8 to make it so. If a parameter is not identified it is not 
possibl'e to find a consistent estimator of it. 

Identifiability depends on the choice of model and on the 
specification of fixed, constrained and free parameters. To examine 
the identification problem consider the model equations in the form 



li. = f • (0) 
1 1 _ 

* » 

where £• and g., are continuous non- linear functions of 9. 
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If, for given '-y and I, a parameter 8 can be determined from 
y and Z , this parameter is identified; otherwise it is" not. 
Often some parameters can be determined from E and/or y in different 
ways/ This gives rise to overidentifying conditions on I and/or 
wh/ch must hold if the model is true.. The "solution of (12) is often 
complicated and tedious and explicit solutions for all 6*s seldom 
exist. - It is sometimes difficult to determine whet;her or not a 
parameter is identified and whether or not the whole model is 
identified* Fortunately, however, there is one way in which the 
computer programs checks, the identification status of, the model. 
-At the starting point of the iterations, the program 

'computes the information matrix (see e.g., Silvey, 1970) for all the 
independent unknown parameters,. If this matrix is positive definite 
the model is identified. On the other hand, if the information ^ 
matrix is singular, the model is not identified. If the information 
matrix is inverted by the square, root method and the n:th pivotal 
element is zero or negative, this is an indication that the n: th parameter 
is not identified. 

' F. Estimation and testing of the ir.odels ^ ' 

Once the model has been specified to be of th.^ form suitable for 
any of the three programs ACOVSM, LISREL and COFAMfl, these programs 
may 'be used to estimate the model from data. This is done by fitting 
y(e) and 2(8) to the corresponding sample estimates z , the sample mean 
vector, and^ S, the sample covariance matrix. The fittijig function is 



' 325 , 

ERJC - . 347 



F = .N[log|E| + tr(Sr^) + (I '(yf^^l ^ ^og\s\ - p] 
where p is the .number of observed variables. F is minimized with res- 
pect to 9. This gives maximum likelihood estimates if the distribution 
of the observed variables is multivariate normal. Standard errors may 
be obtained for each estimated parameter by computing the inverse of 

the information matrix at the minimum of F. 

2 

The minimum value of F provides a x -goodness-of-fit measure 

of how well the model fits the data. This may be regarded as a large 
2 

sample x test, of the specified model against the most general 
alternative model that both y and Z are unconstrained. The degrees 
of freedom for this test is (1/2) (p + 1) (p + 2) - s, where p is the num- 
ber of observed variables and s is the total number of independent 
parameters estimated under the model. If ^ y is unconstrained, the 
degrees of freedom is (l/2)p(p + 1) - s. 

Suppose represents one model under given specifications of 
fixed, free, and constrained parameters. Then it is ^ssible, in large 

samples, to test the model agai^ist any more general model' H^, by 

2 

estimating each of them separately and comparing their x goodness- 

2 2 
of-fit values. The difference in x is asymptotically a x with 

degrees of freedom equal to the corresponding difference in degrees 

of freedom. In many situations, it is possible to set up a sequence of 

hypotheses such^hat each one is a specis^L case of the preceding and 

to test these hypotheses sequentially. 

2 

In a more exploratory situation the x -goodness-of-f it-values 

2 

can be used as follows. If a value of x. is obtained, which is 
large compared to the number of degrees of freedom, the fit may be 
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examined by an inspection of the magnitudes. of the first derivatives 

of F with respect to the fixed parameters • Often such an inspection 

of the results of analysis will suggest ways to relax the model 

^ somewhat by introducing more parameters. . The 'new model usually 

* yields a smaller x^- A drop in \ which is larg.e compared to the difference 

in degrees of freedom^ indicates that the changes made in the model 

■ . 2 

"represent a real improvement. On the other harid, a drop in x close 
to the difference in number of degrees of freedom indicates that the 
•improvement itf fit is obtained by ."capitalizing oh chance" , and the ' 
added parameters may not have real significance and meaning. 
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III. Estimation of Growth Curves 

A, One variable over time 

Consider one variable y being measured on N individuals at T points 
in time t^^, t^, t^. The raw data takes the form of a data 

matrix Y of "order N x T; 



■f" 

. ^11' ^12' ^IT 



^21' ^22' ^ 



2T 



/ 



where v.. is the observed measurement of individual i at time t,./ 

*' ■ J/ 

We assume that the rows of Y are independently distributed wipi 

: ' - " . / 

tl>e same covariance matrix r . Also the mean vectors of th^ rows 

are assumed to be the same, namely 



/ 



However, in this section, the mean values are not regarded as free 
parameters, but instead we focus attention to the mea:\ as a 
function of t. This gives a growth curve describing how the 
po^lation mean of y changes over time; 
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• 

We consider polynomial growth curves of the -form 










,t^ (13) 
















although other mathematical forms may also be considered. The * 






degree of the polynomial h is assumed to be less than or equaj. 






to T-1. When h < T-1, 


the mean vector p is 


constrained and'' tHere 






is not a one-to-one correspondence betveen' 








polynomial coefficients 




this section we 






consider the estimation of these polynomial coefficients. 






V= t^o' ^1' 


. • • > and let 




- 
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1 1 ... 1 






• 




t, ... t^ 










2 2 2 




— 


— ^ P = 
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^1 ^2 '** T 
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• 




. . * 










^1 ^2 T 






















0 






then the statistical model for the data matrix xs 




- 




E(YO = j C'P, 








where j is a column vector of order N with all elements equal to one. 

• 












• 
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If the time points are equidistant it is convenient to use the h + 1 
first orthogonal polynomials of order T as rows of P 
(see e.g. Kendall 5 Stuart, 1961).. 

When 'the rows of Y have a multinormal distribution,, the vector ^ 
of polynomial coefficients C may be estimated by 'the maximum likelihood 
method. The maximum likelihood estimate of £ is 

8 = (PS-^P')-^ PS-^y , " (14) 

where y is the sample mean vector and S is the sample covariance 

Djatrix computed from Y . 

The above result generalizes easily to the case of; several groups 
of indi-viduals with possibly different mean vectors. Suppose, for 
example, that there are two groups with n^^ and individuals in 
each group. Let the first n^ rows of Y be the measurements on 
individuals in group 1 and let the last rows be the measurements 
on individuals in group 2. The growth curves for the two group"; 
may differ so we assume that there are two distinct growth curves to 
be estimated, i.e., 

# 

or in compact form *• 

E(y) = A HP, (ISO 
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where i — 



0 0 



1 0 0 
0 1 1 



1 1 



and 



(1) .(U 



C2) ,(2) 



(1) 



.(2) 



Let U = (1/N) A'A, V = (1/N) k'\ and W = (1/N) Y'V. Then 



S = W - V'U'^V 



(16) 



is the pooled within groups covariance matrix and the maximum 
likelihood estimate of = is (see Khatri, 1966) 



9 = U"-^VS'-^P'(PS"-^P')"'^ 



(17) 
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In general, if there are g independent groups of observations 

with observations in the s"-th group, + n2 + "' * ~ ^' 

the model is still in the form of (15), where A is of order N x g 

and has n^ rows (1, 0, 0), rows (0, 1, 0,..., 0), ...» 

and n^ rows (0, 0, ...» 1). Further, 

~ (1) .(1) . M) 

% h) % 



c(g). frig) 
S ^1 
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and "P is- as before. The s:throw af.H consists o£ the polynomial ^ 
coefficients for group .s.' The growth curves are. assumed to have 
the same degree h for all groups. Even- in the general case .the 
result is given by (17) .where U, V and S are defined as before. 

For practical purposes the maximum likelihood estimate of 5 may be 
obtained- by means -of the computer program ACOVSM (as described iri 
section II).- With this prbgram one can also test linear hypotheses' . ' 
on 5 of the' form ' " _ . 

. ; CHD = 0 ■. ^ . 

where C (u x g) "and D (h x v) are given matrices of ranks 
.u and V, respectively. In particular, one ban test the hypothesis 
that certain coefficients in one or more growth curves are zero and 
the hypothesis that certain groups have the. same of parallel growth 

' • » ^ » 

curves. -One 'can also restrict elements' of H ' to zero in advance. 
, Thus with [j±e ACOVgM program it 'is not necessary to assume that all 
groups 'have growth -Gurves of the same degree. . In this case, of course, . 
5 is/no'' longer given, by (17) but ,can still easily be computed subject 
to the ,zero a priori restrictions. , ' 

As an illustration, ponsider the data in Table 1 taken from Pott- 
hoff and Roy (1964). ' The data is from a dental study in which, the ' , 
distance, in miflim^ters, from the , center of the pituitary. to the 
pteryomaxillary tissue,, was measured on each of'U girls and 16 boys 
at ages 8, 10, 12 and 14. The data matrix has 27 rows and 4 columns, 
the first 11 rows representing the girls and the last 16 rows representing 

tho boys. 

Insert Table 1 about^ here 
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TABLE 1 - '. ' 
Dental Measurements on 11_ girls and 16^ boys 
at 4 different ages/ 

! f 

Data from Potthoff 5 Roy (19p)> Table 1 







Girls 








• Boys 












Age ilk Years 






Age in \Ye;ars 




[ndividual 


8 


— =■= * — 

10- 


12 


^14 


Individual 


8 

* 


10 


12 


14 


- 1 


21 


20 


21.5 


23, 


1- 


26 


25 ' 


29 


31 


' 2 


21 


21.5 


24 


25*. 5 


2 


21.5 


22.5 


23 


26.5 


' 3 


20. S 


24 


24.5 


26 


3 • 


23 


22.5 


24 


27.5 ■ 


4 


23.5 


24*! 5_ 


25 


26.5 


4' 


25. S 


27.5 


26.5 


27 


. 5 


21.5 


23 


22.5 


23.5 


5 


2tf ^ 


23.5 


22.5 ' 


26 


^ o 




21 


hi 


22 .5 


6 


24.5 


25.5 


27 


.28.5 " 


; 7 




22.5 


; 23 


25 

o 


7 


22 


22 


24.5 


26.5 


o 
O 




23 


23.5 


24 


8 r 


24 


21.5 


24.5 


25.5 






21 


22 


21.5 


9 


23 


20.5 


31 • 


26 


10 

* o 


* 




19 ■ 


19.5 


10 


27.5 


28 


31 


31.5 


11 


24.5 


-25 


28 


28 


11 


23 


23 


23.5 


25 














21.5 


■ 23. S 


24 


28 




* 








13 

*• 


17 


•24.5 


26 


29.5' 






• 






14 

• 


22<5 


35.5 


25.5 


26» 




r 








15 


• 23 


24.5 


26 














i6 


22 


21.5 


2^.5 


■•25" 


Mean 


21 . 18 


22.23 


23.09 


24.09 


Mean 


22.87 


23.81 


25.72 

•> • 


TlAl 






> 






« 








f 
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The following two^ questions may be asked- 
(i) Should the growth curves be represented by second 
/ ^degree polynomials or are linear equations adequate? 
. fii) Should two separate growth curves be used for boys and 
girls, or do both have the same growth curve?- 
To answer these questions we set up a model as in (15) with 
N=27, T=4, and g=2 and h=2, with A, a matrix of order N x 2 with the 
first 11 rows equal to (1, 0) and. the last 16 rows equal to (0, 1) 

t 

and with 



(G) 

'o 

(B) 



(G) 



(B) 



_(G) 



Since the time points are equidistant we take the rows of P as the 
first "three orthogonal polynomials of order four, i.e.. 



P = 



X 
-3 
9 



1 
-1 
1 



1 
1 
1 



1 
3 
9 



The maximum likelihood estimate. of H is 
22.704 0.479 '-0.003 
_24.651 0.788 0.050. 
To examine question (i) we test the hypothesis ^ 

This can be done tiy choosing 
1 0 



CG) . (B) ^ 0. 



0 




f . 
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The test statistic tan be traris^fonned to an F distribution 

* 

(see Pottoff & Roy, 1964). In this case one obtains an F=1.19 
with 2 and 24 degrees of freedom. This indicates that the 
hypothesis cannot be rejected. We may therefore regard the 
growth curves as linear rather than quadratic, ^ 
We now modify the model and take 5 as 



I ^0 
^0 



-CG) 
'1 

-CB) 
'1 



and P with only two rows instead of three. The maximum 
likelihood estimate of - is now 



22.689 0.477 



24.923 0.826 



To e){amine question (ii) we set up the hypothesis 5q 



CG) 



^.6 



CB) 



-CG) 



. This corresponds to choosing- 



ll 



1, -1 



D = 



\ 



0 



0 
1 



*Also, in this case, the test statistic can be transformed to 
an F distribution. The tesr gives F = 6.44 witji 2 and 22 de- 
grees of freedom, suggesting that the hypothesis should be 
rejected. Boys- and girls have different growth curves. 



* ! 
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B. AnautoregT A^^ivft model for o ne var iable oVer time 

The development in the previous subsection did not" take the 
covariance structure in Z into account. However, the growth 
curves canr^BrTstim^ted more efficiently and the tesfs will be more powerful 
if the .covariance structure, which arises naturally in repeated 
measurements,* is taken into.account. This covariance structure 
very often has an autoregressive nature. Therefore, in this sub- 
section, .we focus "'attention , to the deviation e^ = - of 
y from its mean value on the growth curve and consider various 

autoregressive models for this.- - ...7 _ . _ . 

The first-order autoregressive model is^ 



e^ = B^Vl * \ ' ^ = 2, 3, T , (18) 



where the residual is uncorrected with e^_^. It is also assumed 
that Z3, uncorrelated. ' A path diagram of this 

model is shown ■■ .i Fig. 2 for the case of T=4. 
It is readily verified that 

Co/ (y^, y^_i) = ECe^ e^^ = e^^J-l' 



•where a^_j = VarCy^.^ = E(e^_p, and that 



Gov (y^, y^_j^) = B^St.! •-• B^-k+l ^-k' 



where o^_^ = Var (y^_j^) - 



Insert Figure 2 about here 
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yi. 






\ — ^ 


y3 




y4 ■ 


* 

CM 

























Z2 



23 



Z4 



Figure 2 — An autoregressive model for one variable over time; 
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Hence the covariance matrix of y is (in thq case o£ T = 4 ) 





i 




<* 






" 1 








1 


2 












2 

°2 ■ 
»3°2 


2 

°3 *■ 




/ 




»4^3°"2 


2 2 
' ^4°3 °4 

t 



(19) 



From. (18) it is seen that E is constrained; its ten variances and 

covariances are function^ of only seven parameters. Since the 

variances are free parameters it is the six covariances that are 

functions of the three parameters ^3 . ^4* In the general 

case there ,are (1/2)T (T + 1) variances arid covariances in I and 

♦ 

.2T - 1 free parameter^. 

The correlation matrix corresponding to (19) is 



^2^3 



P/3^4 



'3 



P3P4 



(20) 



where = 3^(o^ ^^'^^ only T-1 independent correlations, 

namely those just below (or above) the, main diagonal and the other 
correlations are products of these. For example. 



ERIC 



360 



It is seen that the correlations fall off as one moves, away from the 

main diagonal, a phenomenon usually found to occur empirically. 

The pai^tjLal correlation P^j^.j is zero, whenever i < j < k. This is 

readily verified since 9^-^ p..p., = 0 by virtue of (21). 

iK ^ 13 JK 

Higher order partial correlations^, with two or more -intermediate 
variables held constant, also vanish* It follows that in the regression 



of Yr on all preceding variables, the only regression coefficient 
that can be non-zero is ^ i = prediction of y^, only 

the immediate neighbor y^_j is useful^. The effects of y^_2> ^t-3' 
y^ on y^ are only indirect via \y^_2.* 



If the growth curve specification in ( 15) is ignored so that ^ the 
mean vector y is unconstrained, this model can be estimated very 



A 1^ 
easily. Under multinormality, the maximum likelihood estimate of B 

\ ^ 

is just the ordinary least squares estimatp one obtains by estimating 
eaqh regression equation in (18) separately, namely 

^ Vl,t/^-l,t-l ' 

where the s^^ are elements of S in ( 16). Th^ residual variance, 
Var(z^), is estimated as 
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TJie estimation of the growth curves and the 3's simultaneously 
is not so easy. This may be done numerically by means of the ACOVSM 
program. We now show that the I in (19) is indeed of the form 
required by that program. To do so we define = e^ and write 
the equations (18) as (in the case of T = 4) 



t:\ 




1 ' 


0 


0 


0 


Ai\ 




■ 




1 


0 ■ 


0 


^2 


3 






^3. ■ 


1 


0 


^3 






^2^3^4 


^3^4 


^4 


1 




3 


6. ■ 
1 


for i = 2, 


. . . 


T. Then 


if all 3^ ^ 



. (23) 



there is a one-to-one correspondence between k.^, k.j* 
.^2' ^i"''-i/'\-i "The matrix in (23) is^ 



\ 



K3/K2 

'^.4/''2 



0 
0 
1 



0 
0 
0 

1 



= D^TD^ 



and 



where D^r 



diag (l,iC2' ^ y ^a) 

10 0 0 
110 0 
1 1 10 
1111 
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Hence,. (23) can be uTitten 



e = D TD'^^z 



= D Tz* , 



vdth covariance matrix 



1 = 0 •iv*T'D , ' - (24) 



Where iS the diagonal covariance matrix of z* = D^^z- The 

* \ * ~ .* 

2T - 1 parameters k^, Ky Kj, 'J'ii\'i'22' '''tT ^" ^ 

one-to-one correspondence with the originar\parameters •"' 
Ojj, 022* ^YT- Equation (24) is in the\form of (2). 

The whole model is defined by (15 ) and (24). jKe ACOVSM program 

gives estimates of the growth curve polynomial coefficients as well as 

\ 

V ""ll' ""22' •••'-^ir "^^ program also^gives a 
X^-goodness-of -fit-measure for assessing the &.t of the overall model. 
This -measure may be divided into two components measuring the fit 
of "the growth curve model ( 15 ) and the covariance structure model 
(24) separately. " ' • 
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/ 

C. Growth Curves for several variables simultaneously ; 

Sr t 

The model of the preceding subsection will now be generalized to, 
the case of several variables at each occasion. We still assume that the 
observed variables are measured without errors. The case of measurer 
ment errors in the dependent variables will be considered in sections 
IV and V. An example of the type of model to be considered is s\io\^ 
in Fig. 3. Here there are 3 variables for all t and, as before, we 

illustrate with T = 4 occasions. ,' 

I 

I 

Insert Figure 3 about here , / 



I 

The growth curve specification for the model in Fig. 3 is a? 
follows. For an->arbitrary individual we arrange his observed scores 



so that his three scores at the first occasion come first, then; his 
three scores at the second occasion, etc.,' i.e., 



^IV ^12' ^2V ^22' ^23' ^31' ^32' ^33^ ^41' ^42' JaZ' 

/ . is the score on variat 

for variable j is assumed to be 



where y^^ is the score on variable j at occasion t. The growtp curve 



say. As before, the model is given in matrix form by (15), where 

E (1 X 6) = a^Q, 5j2» ^20' ^21' ^22' ^30' ^31' ^32^ 

and 
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P(6 X 8) = 







0 


1 


0 


1 


0 


1 


0 






0 




0 




0 




0 






0 


^2 


0" 




0 


A- 


0 




0 


1 


0 


1 


0 


•I 


0 


1 




0 




0 




0 


^3 


0 = 


^4 




p 




0 


4 


0 


tl 
:> 


0 





The matrix A is a column vector of order N with all elements equal 
to one. If there are g groups of observations, there will be g rows 
in H and the matrix A will as be described in section III.A, 

Without constraints on the covariance matrix Z and with ho 
a priori zero restrictions on H , this model can be estimated as in 
III. A- The maximum likelihood estimate of H is given by (17) • 
Mul tivariate autoregressive models 

— ^ 

We now consider a multivariate autoregressive model which is 

a direct generalization of the Ujiivariate autoregressive model in section 

III.B. This autoregressive model is ' 

■ rt = Ity^-i * !t ' ^ = 2, 3, T, C2C) 

with the.y's measured as deviations from their means. For the model in 



Fig. 3, each matrix will be of the form 
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*11 



0 
0 



B 



12 

(t) 
22 



,Ct) 
33 



(27) 



The residuals in are assumed to be uncorrelated across time but 
may be contemporaneously correlated, i.e., Efz^z^ = 0 for s / t. 
The covariance matrix E(z^zO is denoted If the mean vectors 

and the matrices are xinconstrained, this model may b6 . — - — 
estimated directly by estimating each regression in (26) separately* 
Let 



S = 



:il 



!21 



5l2 



l22 



?T1 



.12 



.IT 



.2T 



.rr 



b^- the sample covariance matrix of y' = (y^, Vj* y^) > where S^^ is the 

covariance matrix between y^ and y ' Then the maximum likelihood estimates are 

,-1 



\t " !t,t-i^t-i,t-i 



and 



\ !tt " !t,t-i !t-i, t-i !t-i,t 
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If the matrices have fi^ced zero elements as in (2?), the model 
may be estimated by means of the LISREL program as described in s,fection 
2. LISREL can estimate the covariance structure but not the gi:owth 
curves specification for the means, IVhen the latter are included in' 
the model' together with the multivariate .auto regressive. model, the esti- 
ination problem is complicated and there does not seem to be any general 

program available to handle this' estimation, IVhen all B-^ are diagonal, ACOVSM may 

5. • - . . ' • * 

be used in the same way as in III.B. 
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IV, Two- Wave Models 
Two-wave, two-variabTe silodels 

In the previous section' all the vairlables were assumed to 
be measured without error, MeasHrement errors in the variables . 
were not taken into account in the models which focused directly 
on relationships between the observed variables. In this and the 
next section we assume that all the observed variables contain 
errors of measurement and focus on the t^tionships among the 
true or late-^t variables. In doing so we shall ignore any 
structure on the mean vector and simply assume this to be un- 
constrained. We may therefore take, all variables to be lneas.ured • 
in deviations from their means. 

We begin with the simple model shown in Fig. 4, where two 
variables are measured at two occasions.- We assume that the. two 
variables measures the same latent variable n, i.e., y^^ and y^^ 
measures on the first occasion and 721,^^ ^21 '"s^^"'®^ ^2' 

'on tho' secdnd occasion. We are interested in the relationship 
between and expressed in the structural equation 



112 = Brij + " ^^^^ 



the regression of 112 on n^ ' In particular, we are interested in 
whether g = 1 and ? is small, i.e., whether the same latent variabl 
are measured on both occasions. 



Insert Fj,gure 4 about he.re 
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The measurement model part of the model may be written as 



\ 



'21 



'22 





1 


0 1 






0 

r 




0 


4- 

1 


1 


0 












(29) 



where it is assumed that n 



1 



and measured in the same metric 



as y, - and y^,, respectively. This model is a special case of the 
general LISREL model with no x. ^ In terms of LISREL, (28) may be / 
interpreted, in accordance with (4), as 



-3 1 



where = and ^2 " ^- ^ covariance matrix of 

(n^, r)^) and let 0 be the covariance matrix of (Cj^> ^ ^^1' ^22^' 
If all 'the e^s are uncorrelated so that G is diagonal, the covariance 
matrix of (y^^, y^^' ^21' ^22^ " - 



\ 

! 


hi-' 'n 








^1*11^^22 










*21 


\^21 *22 °33 




^2^21 


\>-2'^2l ^2'^22 



^2*22 ^ 
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Z has 10 variances and covariances which are functions of 9 
parameters. The model has one degree of freedom. 

Often when the same variables are used repeatedly there is a 
tendency for the corresponding errors (the. e's) to correlate over 
time (see section III3 and Ill-D) because of memory and other retest 
effects.* Hence there is a need to generalize the preceding model 'to 
allow for correlations between e^^ and -^^^^ between 

e and e^^. This means that there will be two non-zero covariances 
12 2— A 

e and e,^ in 0. This model is shown in Fig. 5. The co- 
31 42 ^ 

variance matrix of the observed variables will now be 



Z = 













4*11 " ®22 








^*21 


*22 * ®33 




^•2'?21 


. ^lV21i* ®42 


^2*22 


4*22* V 



1 



This Z has its 10 independent elements expressed in terms of 11 ' 
parameters. H^^nce it is .clear that the model is not identified. In 
fact, none of tl.e 11 parameters are identified without -further 
restrictions. The loading and X2 multiplied by a 

constant and the <^'s divided by the same constant. This does not 

< 

change c^^, a^^, 0^^ and o^y The change ^in the other a's may 
be compensated by adjusting the 6*s additively. Hence to make the 
model identified one must fix one X or one <}) at a non-zero value 

Insert Figure 5 about here 
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Figure 5 — A two-wave, two-variable model with correlated errors. 
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or one-e at some arbitrary value. However, the correlation 
between Hj. and is identified without any restrictions, 
since 

Th's model may therefore be used to estimate this correlation 
coefficient and zo test whether this is oi\e. The maximum likelihood 
estimate of the correlation coefficient \I^^'z2^ai^^ ^^21^43^ ' 
To make further use of the model it is necessary, to make some 
assumption about the nature of the variables. For example^ 
if it can be assumed that the two variables at each occasion* 
are tau-equivalent (see e.g. Lord f? Novick, 1968) we can set both 

and X2 equal to one. Then 'the model can be estimated and 
tested with one degree of freedom* 

' IVo^wave , two -variables models with background variables 

, f 

The model of the previous subsection may be used for the" 
measurement of change between two occasions. However, in many 
longitudinal studies the objective is not only to measure change 
but also to attribute or relate change to certain characteristics 
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V' 




* 




■ 


and events. Such studies must include not only pre- and postmeasures 
but also various backgiound variables believed to influence change. 
The background variables may be socioeconomic variables or other 
characteristics differentiating the individuals pri^r to the 






pretest occasion. 

Consider the model shown in Fig. 6.. The background; variable 
is denoted x. The main purpose of the model is to separate the 
direct effect of on by eliminating the effect of x. 

- The measurement model for y is the same as in (2 9) bat now 






the structural equations are* 






= X + . (301 






The. A in (6) is a 1 x 1 matrix with element one and 6=0. 
The reduced form of (30) is 

<> 






^1 = ^1^ ^1 






= - By,)x + (?2 - 






= ir X + 0 , say. / 






Insert Figure 6 about here 
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As before, we assume that the measurement errors e^^, £^2' ^21 

E have zero means and are mutually uncorrelated and uncorrelated 
22 

with and n^. Furthermore, we assume that the residuals 

12 \ 

and ^^^^ ^^^^ means and are uncorrelated. The Variances of 

5^ and ^2 denoted = Var (C^;, " Var(C2)- 

Let us first consider the identification problem. We^ have five 
observed- variables y^^, 7^2. ^22 ^^^^ ^ ^^^^ fifteen variances 

and covariances. The model has the following twelve -parameters to 
be estimated X^, B, Yj, = VarCx) , "I'll* *22 

i ='1, 2, 3, 4. We have 

♦ 

Cov(y^j,x) = CovCnj.x) = Yj<}' 
Cov(yj2,x) = XjCov(nj,x) = X^y^-J) 
Cov(y2j,x) = CovCn2>x) = 1 
Cov(y22.''<) = X2Cov(n2.x) = \^-n<i> 

Since <}. = Var(x) is identified, these equation? determine Yj, X^, 
n and A2, respectively. FuTthercore, 

Cov(yjj,y^2^ = X^VarCnj) = ^^iji^'^ ^u)' 



which determines i>^-^ , and 



I 



I 2 

Cov(y2j, y22) = ^2^'^'"^'^2^ " ^t^'' * " 

which d'- „ .mines 

Var(o) = ij.22 ^"^r ^^^^ 
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For given ^i' ^2' '^V ' ^ "^w ^""^ equation-. 

• - ^ 

Cov(y^j,y2^) = - B'J'ji , (32) 

Cov(yj^j^,y22^ = X2^YiTt<|) - &^^^) (33) 
^°''tyi2'y21^ = ^i(Yi"' - 6*11), (34) 

Cov(yj^2'y22^ = 4^2^^''* " * ^^^^ 

determine 6 . Then, with B deterruined, Yo = ^ f^Y'i and 1^22 
obtained from (31). The error variances 8^^ are determined from o^^, 
i = 1,2,3,4. Hence it is clear that th^ whole model is identified and 
has three independent restrictions on E. 

How suppose that x cannot be measured without error and write 
X = 5 + 6 , 

where 5 is the true score and 5 the measurement error, the latter 
assumed to have zero mean and to be uncorrelated with 5 a,id everything 
else. We shall consider two cases namely: (a) x has a known 
reliability p' =0^/ and (b) 5 is measured by two congeneric 

XX s ^ 

background variables x,^ and x^. Case (a) is shown in Fig. 7. 

In case (a), the above equations are the same except that ^ 
is replaced by . Since = p^^<{. where P^x is known and <1> 

xs identified, all the other parameters will be determined as before. 



Insert Figure 7 about here 
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Next suppose the errors e^^ ^12 . ^22' 

are xorrelafed.as in section IV .A. Su<ih a mode i is shown in Fig. S.- -* 
Then Q^^ will be added to the right side of (32) and Q^^ will be 
added to the'xight side o£ (35). Equations (33) and (34) still 

determine g forgiven ^2'-^!' ^? " ^ll ^31 

\ ♦ 

dnd 9^^ are then determined by (32) and (35), respectively. Hence -■ 

. i 
•this model has one overidentifying restriction. 

Case Cb) is shown in Fig. 9. Here we write 
= C - 6,. 

' ^2 = ^3^ ^ ^2 . . • ^ 

whete Xj is a parameter to be determined and 6^^ and ^2 

\ uncorrelated measurement errors,, uncorrelated with C and the other 

latent variables. The other equations are as before except that 

X is replaced by C • We then have. three more parameters than before 

namely' Xy o^^ and 0^2-" The parameter = Var(5) replaces 

^ t-.q' = VarCx). On the other hand we have now six more manifest 

parameters, so that the' model has six degrees of freedom with 
• • 

e = e =0 and four degrees of freedom with these covariances 
31 42 . ^ 

"^n c 111 decl'^aiT^axa^^^ '~~ ~ ' ~~ ^ 

The parameter is identified with three over identifying 

. restrictions since 

CovCx2»w)/CovCXj^,w) = Xj, ' 

for w'= Yy^y yj2» ^22* other parameters are 

determined as before. 
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I. Insert Figures 8 and 9 about here 

The models in Figs, 6-9 have deliberately been chosen simple 
to explicate the principal points* The models can easily be 
generalized in two ways. Firstly, the number of pre- and post 
measures y can be more than two. Secondly, we^ could also have 
several background variables with a factor structure, -We now give 
two examples of models of this^kind. ^ < 

C, The Stability of AJLienation " ' ' > 

For the first example we draw on ideas and data in Wheaton et. 
al (1977). Their study wasjconcerned with the stability over time 
of attitudes such as Alienation aAd its relation to background 
variables such as education and occupation. Datg on attitude scales 
were collected <rom 932 persons in two rural regions inlllinois at 
three points in tim^: 1966,. 1967 and 1^71. (See Summers et'al, 1969 
for further description of the research se.tting.) The variables 
we use for the present illustration are the Anomia subscaleand the 
Poiierle.ssness subscal e , taken, to .bj5_indicatArs_oJL Ali . Jfe use: 



these subscal es from 1967 and 1971 only,. The background variables aife 
respondent's ^education (years of schooling completed) and Duncan ''s 
Socioeconomic Index (SEI) . These are taken to be ^indicators of 
respondent's socioeconomic status (SESj. We analyze these variables 
under three different models as shown in Figures lOA-C none of which 
correspond to that of Wheaton et al (1977). The data are given in 
Table 2. 



Insert Figure 10 and Table 2 about' here 
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Figure 10a — Model for study of stability of alienation. 



388 



.1 



389 



04 



1 



12 



AN0MIA67 



r 



P0WERLESSNESS67 




"( AU1ENAT10N67 ) 




(ALlENATiON7l) 




/ 



Figure 10b — ^Model for study of stability of alienation. 
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Figure 10c — Model for study of stability of alienation. 
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Tabl6 2 

Covariance Matrix for .the Models- of Figure 10 (N = 932)' , 



11.834 



6.947 9.364 



// 



6.819 5.091 12,532 ' 

i ■ 

.4.783 5.028 ' 7.495 9.986 

t 

^ ' -f 

- 3.839 - 3.889« - 3.84"l < - 3.625 " 9.610 

' " • i 

' . - / 

-21.899 ,- -18.831 -21.748 -18.775 35.522 450.288 
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Tha m ari'm-Tn likelihood estinates of the parameters H>f the • 
models are. given in Table 3. The main aim o£ the Kheatoii et al 
study was to estimate th^ stability of alienation ove/time, which is 
reflected in the parameter , S, or in the correlation' between 
alienation 71 and alienation 67. As canbe seen^/from Table 3 we 
obtain an estimate of . 6 which is biased upwards if we usa a model 
that does not take SES into account. The influence of SES on 
Alienation. at the two occasions is significant, see Model lOB. The 
'coefficient for 1967, y , is -0.614 with a standard error of 
0.056 and for 1971, Yj* it is -0.174 -with- a standard error equal 
to 0.054. ■ The"^ negative sigrts of the SES-coefficients and 
indicate that for high socioeconomic status the alienation is low ^ 
and vice versa. However, the overall fit of the Model 10^6 is not 
acceptable; with six degrees of freedom equals 71.544. Since 

the same scales are used on'^both occasions, it seems reasonable to 
assume that if the influenc^'of the true score, i.e; Alienation, is 
removed from the measured variables, i.e. Anomia and Powerlessness, 
• there might, still b^ some correlation left between the same 
measures at tlie two occasions. Thus, the Model IOC is intuitively 
more plausible. As can be seen from Table 3 the inclusion of these 
error correlations results 'in a model with an acceptable overall fit 
0^ An Analysis of Verbal and Quantitative Ability 

For the second illustration we 'use some longitudinal |ata from 
a la,rge gro'wth study conducted at Educational Testing Service 



ins'ert Table 3 about, here 
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TABLE 3 

V Maximum Likelihood Estimates for the Models in Figure 10 A-C 

The standard errors of the estimates are given within parenthesis. 

Model in Model in ^ Model in 

Figure lOA Figure lOB , Figure IOC 



. 0.815 (.040) 

X2 0.847 (.042) 

X3 - - - . 

e 0.789 (.044) 

Y, 



2 



^11 



^,22 4.085 .(.432) 



a~ ■ - - - 

a 1.906 (.097) 

en 

o 1.865 (.077) 

a f.827 (.109) 

a 1.969 (.077) 

corr(e ,e )• - - - 

vr 11 21 

corr(e ,e ) 

12 22 

■ 2 61.155 
X 

• d.f. 1 



0.888 f.041) 


. 0.979 (.062) 


^0.849 f.040) 


0.922 (.059)' 


5 331 f.4301 


5.221 (.422) 


0.705 f.0541 


0.607 (.051) 


' -0.614 f. 0561 


-0.575 (.056) 


-0.174 f.0541 


_ -0.227. (.052) 


5 307 f.473) 


4.847 (.468) 


3 742 f.3881 


.4.089 (.405) 


6 663 f 6411 


-6.803 (.650) 


1 717 f.l451 


1.675 (.151) 


16.153 f.56S} 


i6.27^ C.558) 


2.004 (.086) 


2.176 (.104) 


1 786 f 0761 


1.602 (.126) 


1.923 (.097) 


2.098 (.123) 


' 1.904 (.077) • 


1.754 (.124) 




0.356 (.047) 




■ 0.121 (.082) 


71.544 


4.770 


6 


. 4 . 

V 
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(Anderson § Maier, 1963; Hilton, 1969). In this study, a nationwide' 
(U.S.A.) sample of fifth' graders was tested in 1961 and then again 
i« 1963, 1965 and 1967 as seventh, ninth and eleventh graders, 
respectively. The test scores include the verbal (SCATV)' and 
quantitative (SCATQ) parts of the SCAT (Scholastic Aptitude Test) * 
and achievementyt-ests in mathematics " (MATH) , science, (SCI) , social 
Studies (SS) , reading' (READ) , listening (LIST), and writing (imiT). . 
The examinees foj: vhich complete data were available for all the 
grades 5, 7, 9 and 11 wj^e divided Into four groups according to sex 
and whether or not they were in the academic curriculum ^in grade^l2. ... 
The four groups and their sample sizes are as fol]j)ws:\ 

Boys academic (BA) : ■ N = 373, ^ 

Boys non-academic (BNA) : N = 249, '| 
Girls. academic (GA) : , ' N =383, \ 
Girls non-academic (GNA) : -N = 387. 
Scores on each test have been scaled so that the unit of measurement . 
is approximately the same at all occasioas. All analyses reported 
here are based on information provided by the means, standard deviations 
and intercorrelations of the 32 i^ariables (8 tests at 4 occasions) for 
the four groups. * ' 

In this example we use the six tests MATH, SCI, SS, READ, SCATV, 
SCATQ in grades 7 and 9 only and only the group GA. In later sections 
we use data from other grades and groups as well. Earlier studies 
(JOreskog, 1970a) suggest that these tests measure two oblique factors 
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whic!f may reasonably be interpret<^d as a verbal (V) and a 
quantitative (Q) factor. We setyup the model in Fig. 11, which 
represents a model for the measurement of change in vei-h^l and 
quantitative ability between grades 7 and 9- Sincd there are no 
background variables 'in this .mo^el We may for estimation purposes ^ 
treat the pretests as the indispendent variables. Hence we use the 
notation x for these. Note/ that the model includes the following 
features: I / " ^ 

(i) On each occasion the factor pattern is .postiilpLted to. be , 
restricted -in the following way, MATH and/SCATQ are pure 
measures of Q. -READ and'SCATV areipure, measures *t>f V. ' 
"V SCI and SS and cpmposite measures of V and Q. This iniplies 



^1 that there are four zero loadings in both Ax. ^ y • 
, To fix the scales for V and Q we assume that they are measures 

in the same ^&iits^jis-5CATV and SCATQ, respectively^_Jlu5 - 

* Tmeans that-^^^terierlir"^^ in each column of and A 

\(ii) .>lVis"^ostulat6d that Q^t^ffects Qg only and not Vg and ^ , 
similarly for V^. This means" that there are tyfo zero > 
^ coefficients in r. Furthermore, we postulate that the 
residuals Ci and ?^ are uncorreiated, which means that, 
whatever remains in Qg and Vg after and are accounted 
for, is uncorreiated with eveiything else. 

(iii) The errors or unqiue factors in 5. and e are asstiraed to 

/ ' *** ' " 

bb uncorreiated both within and between occasions. 



: 'Insert Fag&re 11 about- h^eVe 
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Figure 11 — 



Modest for the measurement of change in verbal and quantitative 
ability 'between grades 7 and 9.- • ' 



The maximum likelihood estimates are given in Table 4» 
Jhe.rathel: low lo.adings o£ SCI and SS on Q at both occasions may 
seem a little surprising. However, an inspection of the items in tests ^ 
SCI and SS reveals that these are mostly verbal problems^^concemed 
with logical reasoning in contrast to the? items in SCATQ which are 
mostly numerical items measuring the ability to work with number^. 
- The small residual variance 1.85 of i;^ means that V^^can be ^ 
predicted almost perfectly from V^. This is not quite so for 

Q since :we here have a residual variance of 18.49. However J this 

' - ' ^ * - ^ ' • i 

way he due to the more rapid increase in variance of Q from' grade ' * 

^ > 7 to 9,^which is manifested in the increase in variances .which is 

143.54;,- 103.87 ^ 39.67 for Q and 117.15 - 115.41 = 1;74 for V.. 

There is a reason not to look at each number in Table 4 too 

seriously and this is the poor overall fit of the model as evidenced 

by the x -value of 217.79 with 47 degrees of freedom. We shall 

• ^ ^ * ^ 

therefore investigate the reason for this poor fit and demonstrate. 
f that LISREL may be used hot pnly to assess'or measure the 

- \ ■ ^ ■ . • , 

goodness of fit of a* model but^also to detect the parts^ of the model 
where the fit is poor. Taking the more fundamental assumptions of 
linearity and multinormality. for granted, lack of^fit of the model 
in Fig. 11 may be due to one or more pf the postulates (i), (ii) or (iii) 
not* being reasonable. We shall therefore investigate each of the^e 
separately. , / * ^ - * 

To investigate (i)V we set up a factor analysis of the pre- and 
posttests separately assuming the postulated two-factor structure. 



Insert 'Table 4 about here 
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. • TABLE 4 , . 

U»ximm Likelihood Estimates ( LISREL) for the Model of Figure 
, , Group: GA -(Girls Academic), N = 383 



11 



A = 



A = 



Q7 
0.97 
0.20 

0.25 
0;* 
0> 

% 

0.8S 
6.24- 
0.36 
0.* 

0. * 

1. * 



. Q7: 

/l.lO 



7 

103.87 



♦ = 



( 



3.8 
92.58 

18.49 



n = 




. ■ ^7 






*0.* 


MATH7 


5.68 


• 0.52 




5.49 


0.84 


' SS^ 


6.61 


1.21 


READ- 


6i80 


1.* 


SCATV- 

/ 


4.44 Y Vc 


- 0.* 


SCATQ- 

/ 


7.iO *' 


\ 




e 


0.* 


MATHg 


4.80 


0.64 




6.57 • 






7 74 


0.95 


READg 


- 6;49 


1.* 


SCATVo • 


4.47 




SCATQg 


8.23 






-r- ■ - 


• Loo 












92 J 58^ 






115.4 V 







- ^2 , 
0.* 

• 1.85 

^9 
•'101.54^ 

'117. 15y 



.^9 



LOl .54 

217.79 with d.f. = 47 
* the value of this parameter was specified by the model 
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i ' ^ 2 

.This gives x = 17*64 for the pretests and x = 2.62 for the 

posttesti both with 10 degrees of freedom. Although the fit is not 

quite acceptable in grade 7 we take the postulated factor structure 

to hold both for the pre- and posttests- So we must continue 'to look 

for lack of fit due to (ii) or (iiii). 

\ The postulate (ii} is concerned with the^ inter-retati^^^^^ 
the four factors ^Q^, V^, Q^, and V^. The most general assumption 
is "that these- four factors aVe freely intercorrela^ed and this is 
equivalent to a LISREL model with all four coefficients in f f^^e and 

; with^ y free as a full symmetric matyix. Hence, it is clear that, 
the assumptions made in (ii) is the intersection of the two hypotheses 
' r is diagonal'* and. V ? is diagonal". It is therefore useful 
to test .each of the four possible hypotheses.. The results of -these 
analyses may be presented in a 2 x 2 table as in Table 5. The row 
marginals of the table represent x^-values with one Hegrees of 
freedom for testing the^Jiypothesis that is'cliagonal. It is seen 

7 that this hypothesis may be -^rejected. The column marginals represent* ^ . 
){ -values with two degrees of freedom for; testing the hypothesis that 5| 
r, is diagonal. Th?.s hypothesis seems quite reasonable. \From these, v. 
analyses it is >plear that "r diagonal and H' free" is the most 
reasonable assumption to retain. The overall fit of this model is 
X^ =196.4 with 46 degrees of freedom. Since this is still too 
large we must continue' to investigate, (iii). 



Ina^jt 'table 5 about here 
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TABLE 5 



Test of Assumptions ( ii) for the Model in Figure 
Group: GA (Girls Academic), N = 383 





* diagonal^^"^^ 


* free 




r diagonal 


^217.8 


X^ = 196.4 


. X^^- 21.4 


E free 


- 216.8 ^ 


V = 193.7 


' i ■ 




X^ = 1-0 
2 


X2 =.2..7 
2 





374 



The assumption in (iii) ' is that the_.unique factors in and 
e . are irncorr elated both within and between sets. That they- are 
uncorrelated within sets should not be ^estioned since we have alr|?ady 
found that the fostulate^ factor analysj^s model holds for both pre- 
and posttest. That they are uncorrelated between sets, however, is 
more questionable because of specific factors in each test. This 
means that thejunique factors for corresponding tests should be 
allowed to correlate. To account for such correlations, Jttreskog 
(1970a) introduced so called test-specific factors, i-e- factors which 
do not contribute to correlations between tests within occasions 
but between the sanfe tests at different occasions. In this case, 
when there are, only two^ occasions,, it is not possible to define, 
(identify) test specific factors but we can merely introduce 
correlajtio^s between unique factors for corresponding pre- and 
posttests. 

The model in Fig. 11 is therefore modified as in Fig. 12. ^ 

This revised model can also be estimated with the LISREL program. 

The analysis of the revised model gives the results shown in Table 6 

which also gives standard erroffe of the estimated parameters; It is^ 

seen that all the estimated parameters are significantly different 

2 

from zero. The test of overall goodness of fit gives x - 65.63 , 

" . \ 

with 40 degrees of freedom. This represents a reasonably good fit 

of the model to the data. An approximate test of the? hyp^ljj^es * 

that the unique factors are uncorrelated between occasions is 



^ Insert Figure 12 and Table 6 about here 
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Figure 12 Revised model for the" measurement of change in verbal and quantitative 
ability between grades' 7 and 9. 
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TABLE 6 

Maximum Lj.Xeli.hood Estimates ( LISREL) for the Model of Figure 12 
Standard Errors in Parenthesis' 



Group: GA (GiTls Academic), N = 383 


1 






♦ 




% 






• 1.01 (0.05) 




V 

' MATH^ 




0.13 (0.07)"^ , " 


. 0.60 (0.07) : 


sci^ 




oy2 CO. 09) ■ 


0.98 (0.09) - 






0 * 

r- 


1.24 (0.05) 


READ^ 




0.* 


1.* 


SCATV^ 




1.* V 


0.*. ' 


SCATQ^ 



99 

0.93 (O'.OS) 
0.13 (0.07J 
0.25 (0.08) 
0.* 

0.* ■ 

-1.* . ' ■ 



0.* . . ■ 

0.77 (0;08) 

0.82 (0.08) 

0. 98 (0.04) 

1. *. 



MATHg 

SCIg 

SSg 
READg 
SCATVg 
SCATQg 



- ^7 

J. 06 '(0.05) 

0.* • 



0.* 

0*.98 (0.03) 



* the 



100.57 <10.86) 
90.53 (8.46) 

•J 

22.63 \-4.41} 
8,42 (1.73). 

> 

^9 

136.52 
102.62 



90.53 (8 .,46) 
110.45 (9.74) 



••i§ 
2 

. 8.42 (1.73) 
.6.94 (1.58) 



102 .& 
112.53' 



65:63 -with d.f. = 40 
.value of .this jpararaeter was specified by the model 



§ ' 
1 



obtained as = 196.4 - 65.6 = 130.8 with 6 degrees'of freedom so that, 
it is clear that this hypothesis is quite unreasonable. The 
Ifariances,- covariances and coirelatipns of the, unique factors are' 
given in 'Table 7. A comparison of the covariances with their 
Standard errors reveals that all covariances except possibly the one 
between 5, and e *' is significafitly non-zero. , 
E; Comparison of change between groups 

In many longitudinal, studies both pretests and posttests are 
administered to several groups of. individuals and one is interested 
in compai^ing the*chaftge in various quantities between the di«er.entj 
groups. Such groups jnay be, for example, groups having* different 
socio-econonfic background, groups having obtained differe^ amounts 
of schooling or training either prior to the pretest occasion oi<^' 

between the two occasions or groups having obtained different treatments 

« - - ' » 

between the two occasions. hTien we have several groups it is natural 

if 

to assume that the distributions of the latent variables are different 
■for the -different groups. SOrbom (1974 j has developed a mode.l in which 
the mean vector as well as the covariance matrix of the latent variables 
may vary from group to group. The structural equations will therefore 
be different for different groups. On the other hand, the matrix A , 
which describes the relationships between the ''observed test scores and 
the datent variables, is considered an attribute of the observed 
variables and is therefore assumed to be the s.'ime for all groups. 

It is assumed -that observations from- different groups are , 
independent. For a "random" examinee from group g ye write his 

Insert Table 7 about here 
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TABLE 7 

Variances » Coyariances and Correlations for the 
.^ Unique Factors in Table 6 ( Figure 12) 

X 

Standard Errors in Parenthesis 
i Var (6.) ■ Var (e.) Gov (6.e.0 Corr (6.e.) 



I 


27.75 (3 .'78) 


17.67 


(3.88) 


-3.47 (2.78) 


0.157 


2- 


29.59 (2.37) 


' 41.15 


(3738) ; 


• 9.60 (2.10) 


0;275 


3 


40.27' (3.60) 


50.89 


(4.21) 


6.15 (2.82) 


0.136 


4 


44'.'21 (4.25> 


40.34 


(3.59) 


7.52 (2.89) 


0.178 


5 


24.37 (2.47) . 


. 24.84 


'(2,60) 


12.04 (2.05). 


0.489 


6 


54.28 (4.87) 


"74.53 


(6.73) 


22.84 (4.40) 


0.359 
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observed scores, using the notation in ( 9 ) 



z _ = V + Af „ + e „ " . - (33) 



"Note that^both v and A are the same for all groups.' The con- 
stant vector ' V represents the origin or level of the. tests in the 

sense that when f = 0 then E(z = v for all groups. This is 
-g - - g - 

considered an attribute of the tests and' the scoring procedure. Let 
the mean vector of f be denoted 6- . Then the mean vector u . 

of z is (c.f. equation 0-0)) 

-g - u . . 



p = V + A9 / "• ^■^P 

-g - — g - . 



and the covariance matrix is Ccf- equation (11)) 



Z = A* A' + V„ 
-g — g ■ -g 



(35) 



where * is the covariance matrix of f„ and "9 the covariance 
' -g . -s 

matrix of e . . ' ' 

-g ■ ■ 

There are two fundamental indetermif.acies ia (34) and (35). ' Every 

factor in f may be subjected to an arbitrary linear transformation 

which may be different for different, factors' but the same for all 

individuals in all groups. The effect of such transformations may be. 

cpmpensated for by adding a. constant vector to v and by a scaling of 
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the columns of A , in such a way that both p and I are- 
unchanged for, all groups. This indeterminacy means that both the 
origin and the scale for the factors are arbitrary. These may 
therefore be chosen arbitrarily, but must be the same for all groups. 
It' is convenient to fix the origins and 'the scates^by choosing the 



vector e equal to 0 - for one group and by choosing a * one in* 
each column of A . . - " 

Models of this kind may )be estimated by means of the COFANM 
program described in II. This gi\:es maximum likelihood estimates* of the 
and, A and of the mean vector 9 and covariance inatrix ^ as 

^ ^ - -.g * "S, 

well as the cov^riance matrix „ of the unrque factors for each 
group.' One may- postulate almost any pattern in A^ and ^ 

,and any degree of invariance between groups. For example, one 
may postulate that y ^ and sdme part of,^ are\invariant over 
groups. \^ 

Comparisdn of Change in Verbal Ability. between Groups - ^ 
To illustra^, the method of* ^he preceding subsection we make use 
of the data introduced' in, section IV. D.^ This time we use the data 
for all the four groups but we use a somewhat simpler mbdel than that 
of Figures IL and 12. We shall' use scores on the reading and wri^ng 
achievement tests in grades 7 and 9 only. The model is shown in 
Fig. ^13./ Here we are mainly concerned with,. the comparison of the 
^ differences i^ mean changes and in the regression lines of Vg on V^ . 



Insert* Figure 13 about here' 
'..The regression of Vg on V^' in group g is ., 
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Figure 13 — Model for comparison of change in verbal ability between groups 



413 



ERIC . , 



414 



where. 



g ng 'g 5g ^ \ 

The maximum 'likelihood solution is given in Table 8. If one 
takes the intercepts a as relative measures of change, remembering 
that, the scale chosen such that a is zero for group BA ^ one 

- ' . 7 g 

finds.that' grouR.^'^^GA has increased t^ieir verbal ^ility most 

" "V -^"-^^^ t . 
followed by groups BA , GNA and BNA in that order. H6weyer^^this 

* " " " * . h 

is not the whole story. For since the slope of the regression lines 

- ^ ^ ' ; ■ • " , : . > 

also differ between groups one should take this also into account . 
when interpreting--t:he data. Probably the best way of looking at the 
results is to use the estimates ^ and \ to draw contour ellipses 
for each gtoup as in Fig. 14 . With this kind of plot one can fix a 
given true pretest score .and , find the likely range of true posttest , 
score for^the various groups. For example, at K = -15, approximate 
95% confidence intervals for n .are. 



GA: -17.32 ±r\ < -^.63, 
PA: -22.40 ±n ± -1*038, 

GNA: -26.36 n <. 70-87, 

> 

BNA: -29.60. <. n" <. -2.-93. 
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At C -10 thes^ confidence intervals .show a different pattern: 
"GAf 0.18 <. n <. 16.34 . 
BA: -3,46 <. n <. 19.09 ' • ■ 

•-^ GN^A: -3.62 n ^ 19;18- 
BNA: . 3.02 < n < 13.46- 



Insert Figure 14 and Table 8 about here 
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Figure 14 — ETS growth study: * Verbal ability, grade 7^ - 9. 95 per cent regions 



•fABLE 8 

MaxiiBum Likelitiood Estimates for , the Model of Figure 13^ 
Siimiltaifeous. Analysis for all Four Groups 
G'rdupsr BA (Boys academic) N = 373 GA (Girls academic) N = 383 /' 
BNA (Boys non-academic) N = 249 GNA (Girls nbn-academic) N = 387 
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^ V. Multi-Wave Models 

a . - . 

A. Multi-Wave, One-Variable Models 



' SuRpase one faUible measure. y\ is administered repeatedly 

to the same group of people. An appropriate model for this situation 

" « * 

,1s shown in* Fig* 15 in the case of four occasions. In the following 



Insert Figure IS about here 



we discuss all models in terms of four occasions^, the generalization 
to an arbitrary number of/ occasions will be obvious at a^l stages, 
-Such models have been termed simplex models by Guttman (1954) to 
designate the typical pattern of intercorrelations they give rise 
to. Anderson (1960) formuUted^this model in ternis of various 
stochastic processes and treated the identification problem and ^ 
JOreskog (1976b) treated the estimation problem. An applicatiop. 
to the measurement of academic growth has been given by Werts, Linn 
and JOreskog (1977) and applications to sociological panel analysis 
have been discussed by Heise (1969), Wiley and Wiley (1970) and 
Werts ,^areskog and Linn (1971) . ' 

* The unit of measurement in the factors n. may be chosen to. be 
the same as in y. , i = 1,2,3,4, The equations defining the model' 
arc then, taking all variables as deviations from their mean. 



y^ = + , i = 1,2,3,4 , (36) 



^ = B^n^_j + 5i V i = 2,3,4, (37) 
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where the e. are uncorrelated among themselves ind uncorrelated 

with all the and where C^^.! is uncorrelated with , 

i=l,2'j3. The parameters of the model are = VarCn^, = Var(e^), 

i = 1,2/3,4 and Q^, &y $4. (We use the symbol 4- 

here to denote the variances of the dependent variables. Since there 

are no independent variables there should be no confusion.) The 

residual variance Var(?^^j) is a function of ({.^^^ , and 

namely Var(?.^p Vj.^^ -^l^i^' ^=1-2,3. The covariance matrix^ 

°f ^1.' ^2.' ^3 ^"'^ ^4 " 



Z 













*2*^22 








• ^3*2 


:*3"^33 






^3^2 


"V3 


*4''®44 



(38) 



r 



It is sfeen from (38) that although. the product 82*1 = ^21 identi- 
fied, &2 *1 are not separately , identified. The product \ 

B A is involved in" the off-diagonal elements in the first column 
^2^1 

(and row) only. We can multiply ^ constant and divide -by 

the same constant without changin^the product. The change induced by 
<}. in o,, can be, absorbed in 6 , in such a way that o^^ remains 
unchanged. Hence ' 6 = Var (e^) is not identified. For and Hj 

we have . : 

4,- = °52°21 .■ • 



'31 



. °43°32 

*3 - -~6 
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so that (|>^ and 6-, and hence also 9^^ and 0^^, are identified* 
With $2 and (j)^ identified, and 3^ are identified by 

and 



a>-. The middle coefficient 

43 , ' 



$2 is overidentified since 



^41 



= a 



32' 



Since both^ (J>^ and *8^^ are involved in a^^ only, these are ^ 



44 

not identified but their sum a., is. 

44 



This analysis of the identification problem shows that for the 
''inner" variables Y2 and y^, *3' ^®22* ^33 ^3 
identified, whereas there is an indeterminacy associated with each of 
the "outer" variables y^ and y^. To eliminate these indeterminancies* , 
one of the parameters (j)^, 8^^^ and niust be specified and 

one of the parameters ancf 8^^ must also be specified. Hence 

there are only nine independent parameters and the model has one degree 
of freedom* In the general case of T >_ 4 occasions there will be 
3T - 3 free parameters and the degrees of freedom is^ (1/2)T(T+1) - (3T-3) 

The estimation problem associated with the simplex model is a 
straight-forward application of the LISREL program using the option 
of "no - x". The L I SREL equations are 
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0 
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(39) 
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r 
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0 


0 


0 




1 




X 




' 1 


0 












0 ■ 




1 


.. 0 










Q 

i, 


0 


-^4. 


1. 











(40) 



.In (39) we have taken ^1 " ^4 " ^ eliminate the indeterminacies 
' and in (40) we have defined x,^ as n^^- In LISREL it is inconvenient 
to treat = Var(nj^) , i = 1>2,3,4 as free parameters, so instead^ 

of = Var(n.), i = 1,2,3,4 we take iji. = VarC?.), i ^ 1,2,3,4 

as free parameters. It is easily realized that the ^. and the i^. , 
i = 1,2,3,4 are in a one-to-one correspondence. So the parameter 



matrices in LISREL are 



and 



Ay =1 B as in (40), 
Y = diagCiJij, 



0, = diag(0, c\ , 0), 

• ^2 3 



Bi Multi-Wave, Two-Variable Model.s 

The direct generalization of' the model in Fig. 5 to the case of four 
occasions is sliown in "Fig. 16 . 



Insert Figure' 16 about here 



With x' = (x^, x^, x^,- x^) , y' = (y^, y^, y^, y^) , the model is 
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where = diag (X^, X^, X^, X^) . The ^covariance matrix of z ^ 
(X' . y')' is . . ' . ' 
" " • (l 



with 




, 11 



where 0^ and 0 are the covariance matrices of n, 6 and 
e , respectively,. It is seen that may be multiplied by a^nonzero 

constant, * divided by the same constant and with 0^ and 0 
properly adjusted, E will not change. Hence. the model is not 
identified. One restriction is needed to make it identified but there 
does not seem to be any meaningful way to choose such a restriction. 
We shall therefore consider two other models which are both identified 
(see Jareskog § Sarbom, 1976a) i These models represent different 
specification of the correlation structures for the errors in 6 and 
as follows: 

Model A: The errors are uncorrelated. 
Model B: The errors have one common factor. 
Model A, is sho\vn in Fig. l7 and model B in Fig. 18. In both model 

■ 393 427 



Insert Figures 17 and 18 about here 

the, covariance matrix # of n is restricted to be generated 
by a simplex' or first-order autoregressive model, i.e. 



n. - 1 C. , i = 2,3,4 



This implies that' 



4 = 



(43) 



^where, as before, = VarCn^) , i - 1,2,3,4* We now consider the 
LISREL specification of each of these models. In both models we 
treat iboth x and y as dependent variables and use the •»no-x" option. 
Model A • ' 

the LISREL specification is straightforward: 



(44) 




and (40) . 
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As before, LISREL treats j^^^ ='Var(C^) as primary parameters rather 
than =s Var(Ti^); *but estimates of (J. are obtained as a by- 
product* The one-to-one relationships between^ and' , 
i«l,2,3,4 , are ' - 



*1 = *1 



.2 



The covariance matrix of e * is diagonal. 
Model B /"^ . 

Model ^ B -assjuaies ' that the correlatibns between the errors 6 
and c ii^ I^i'g. IS.a^e accounted for -by one common' factor . These 

coinmon factors s and s are test specific factors in contrast 

. X y . , . ^ ' 

to the factors rij, - which are occasion ff.pecific 

factors in the terminology of JOresTcog (1970a). The test specific 
factors 'S and s are assumed to be uncorrelated and uncorrelated 

^ y 

with n , 6 and £ . • 
The equations for Model B are 



X - n + as + 6 , • * 

«. ^- «. X — ^ 

•y-=: Dj^^ + Y Sy + £■ , , 

where a and y are factor loadings relating the observed .variables 
X and y to the tes.t-specific factors s and s.., respectively. 

The factors s and s are scaled to unit variance, for convenience. 

X » y , . 

Model A is a special case of Model B namely when both a • and y_ 
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are zero,- The hypothesis a = 0 and Y ^ = Q may be tested with 
eight degrees of freedom. 

. The LISREL parameter matrices are specified as 



A ^ 
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°1 
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°2 


0 
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0 
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°4 
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• 0 


0 
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^1 


0- 


' ^2 


0 


0 


0 




0 


0 - 




0 


0 




0 


0 


0 


^4 


0 

r 


^4 



B = 



1. 
-B, 
0 
0 

0 
0 



0 

1 

0 
0 
0 



0 
0 

1 

-^4 
0 

0 



0 
0 
0 

1 

0 
0 



0 
0 
0 

■0 

1 

0 



0 
0 
0 
0 
0 

i 



V.= diagCj,^, '^4, 1, 1) 

where, as before (|/. =*Var(5.) , 1=1,2,3,4 and 0^ and G are 
diagonal as before. 
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C. Estimation bf Four-Wave Models for MATH and SCATQ 

To* illustrate the models o£ the previous subsection we use the 
data on the variables MATH and SGATQ from all four occasions. The 

maximum likelihood estimates of the various parameters are shown 

2 * ^ ' 

in Table 8 along with ,x ~goodness-of-fit-values and corresponding 

degrees of freedom. It is seen that model A is clearly rejected in 
favour of model B. The parameters listed in Table 9 are those that » 
come out of the LISREL pro-am and which are used^o maximize the 
likelihood function. Some of these may be very difficult to inter- 
pret in a meaningful way. However, from these estimates one can 
compute various other parmeters which are more^ easily interpreted. 

Table 10 gives the estimates of the factor variances and the squared ^ 
2 

correlations R^^ between n^^ and n^^^j^^ for model B and Table 11 
gives the covariance matrices of" the errors c* = y - D n and ' 
■ 6* = X - n , i.e. the partial covariance matrices of y and x after 
elimination of n. Table 12 gives the corresponding correlation 
matrices., ^ 
Frpm Taible 10 it is seen that the squared correlations 

2' 

are quite high. There is a very high stability of the quantitative 
factor over tine. This is also indicated, by the stability of the 
e-coefficients in Table 8. Table 11 i:eveals that covariation among the 
errors is present for the SCATQ tests to a larger extent than for the 
MATH tests. Table 12 shows that the correlati|)ns among the e* s are 
in general higher than those among the 6* s. 'The latter axe indeed 
very small. Hence the model accounts for the intercorrelations among 



Insert Tables ,9, 10/ 11, and 12 about here 
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TABLE9. 

- Mtxiami Likelihood Estiwttes for Model» A and §.with x » MATH 

and X - SCATQ 





oup: GA (Girls Academic) N 






•MedeiA... 




. I 




0.85 


h 


1.13 


1.06 




1.23 


1.14 




1.31 


• 1.21 


■k j 
- 1 


1.22 - 


1.22 


03 


1.01- 


#-1.00 


Si, 


4.06 


1.05 


-2 




57.. U 




9.28 
^0.29 


10.93 
13.74 




2.37 


5.79 






5.94 




6.20 


, ' S.84 




■ 5.77 / 

"^7.55 


2.29 
^ 6.83 


o 


4. §3 


4.47 


ej 


6.r8 

; - •7.40 


^ * 5.83 
^6.87 


I' ; 

X 


7.14 
72.49 


6.51 
% 

23,.18 


d.f. 


- 17 


- . 9 



Additional paraaeters • 
Model 





« 0.97 


Tl 


« 1.48 


n2 


- 0.26 


Y2 


» 3.51 




- 4.59 


Y3 


» 4,66 


0** 


» -0.92 




. 4.90 
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TABLE 10 
* * 



Factor Variances and Squared Correlations 
for 'Model B 



Model B 





:■ r2 

1 


57.31 




96.23 


0.«86 . 


\k)9.97 : 


0.875 


127. P3 


'0.954 







f •. -A 



A 




49.1 435. 



TABLE- U . 
Cpvariance Matrices of e* and "6* for Model B 



22". 17 
5.19 
6.90 

^7.25 



46.31 
.16.36 
17.20 



68.91 

22. es 



66.39 



36.22 
0.25 
4.45 

-0.89 



34.17 
. 1.1^ 
-0.24 



26.31 



-4.22 



47.49 
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TABLE 12 

Correlation Matrices of e* and 6* for Model B 



6* 



1.00 
0.16 
0.18 
0.19 

1.00 
0.01 
0.14'" 
-0.02 



1.00 
0.29 
0'.31 



1.00 
0.04 
-0.01 



l-.OO 
0.34 



1.00 
-0.12 



1.00 



1.00 
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the MATH tests much better than the intercorrelations among the 
SCATQ tests. 

Multi-wave, two-variables models with background'' variables 
Although the multi-wave, two variables model with freely inter- 
. correlned errors between occasions is not identified, it becomes 
so as soon as one or more background variables are included. For 
the case T=2 . this was demonstrated in section IV.B. A model with 
T=4 and two congeneric background variables anda^ may be specified 
as follows. The structural equations are^ 
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^2 


c + 
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-^4 
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\ 











(45) 



The measurement model for x^^ and X2 is 







/ 1 

1 


5 + 












\ 2 



(46) 



and the measurement mddel for y is the same as in (44). The co- 
efficient Y measures the direct effect of 5 on and is expected 
to decrease as t increases. In (46) we have taken 5 to be measured 
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in the same units as x^. If there is only one background variable 
X, (46) is replaced by x = 5 , i.e., we take X = 1 artd 6 = 0. 

A General Model for Analysis of Longitudinal Data 

In concluding this section we develop a genejal model for analysis of 
longitudinal data. All the models jnsidered in the other sections of this 
chapter are special cases of ' this general model. ^ 

Suppose that several variables are measured at T points in time: 
tj, t2, ^ot necessarily equidistant, >/here time is measured from 

an arbitrary origin and with an arbitrary unit of measurement. Let p^ 
dependent variables be measured at occasion t, where t may be t^, 
-or t^,. and' let y^ = (y^^, V^^. yp^^^ be a vector of tliese p^ variables. 
Neither the number of variables nor the. variables themselves need to be 
the same at all occasions, although in most applications they will be' so. 
At each occasion it is assumed that y^ has a common factor structure with 
m correlated common factors = ^\t> ^2t' * *' \ t^' ^^^^ • 

Xt = V V !t ' ■ ^'^^^ 

where y is .the mean vector of y^/^ is a vector of unique factors, 
and A is a matrix of order p. x m of factor loadings. 

In addition to the dependent variables Y^* assume that q 
independent variables x" = (x^, x^, x^) are measured representing ^ 

characteristics and conditions existing before the first occasion and 
assumed to influence the dependent variables y^. We assume that x also 
has a factor structure with common factors 5" = U^* ^^^^ 
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whefe V is the mean vector of-x, J the vector of unique factors 'and 
A_ theXmatrix of factor loadings of order qxri. 

The^ structural equations connepting the D*s and § are assumed 
to be 



/ -3t = ^t? -^.^t 3t-l''-*'-^t' ■ " C50) " * 

where A is a regression matrix of order m x n and B is a regression 

t , t: . 

matrix of .order^m^. x m^ The vectors = tf^j^* ^2t*^ ^m t^ 

vectors, of residuals assumed to be correlated within occasions but 
uncorrelated between occas^ions. As before, t may be t^, t2> t^ 
and if t = t. then t-1 is t. ,^ 

/ Equations (47) through (50) constitute the basic general model 

considered in this paper. A special case of this model is when there are 

/ ' ' " ■ ■ ' " • " 

^ho independent variables x. Then equation (48) is no longer included in 

the model and equations (49) and (50) are replaced by the single equation 



Dt = ?t Dt-l Hf ' ' C51) 



Equation (4 7)irfay be written more compactly as (here illustrated with 
T = 4 occasions). 
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(52) 



and equations (49) and (50) may be C9mbined and written as (in the 
case of T =,.4^dccasions) 
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(53) 



This shows that the model is ^ LISREL model with J- 



' • ».v 



y = y + AyH + f . 



(54) 



X = V + A ^ + .6, 
. • -X. 



(55) 



(56^. 
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with Ay of order'pxm, B of order mxm and r of order mxii, where 

P ~ P '•'^P ^ ■''Pi- m = m + m + • • • + m • In the 

tj t2 t^ . Zj. 

special c^se when there is no x, (55) is omitted and (56) should be 
interpreted as Bn = ?. Each of the matrices A^, B, r and A^^, 
t = 1, 2, T may contain fixed, free and constrained parameters 

as in section II.D. " - - 
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VI SUM>t^RY 

• • ■ ■/ ■ 

^ Injtfiis chapter we have developed several model^ suitable for 

analyzing longitudinal data and cortsidered, the statistical problems of 
model specification, identification, estimation and testing. Almost 
all of the models may be estimated and tested using three computer 
program^ ACOVS, LISREL and COFAMM, which are described briefly in 
section I] 

Section Iir^fe^s with the estimation of polynomial grpwth curves 
describing the means df response variables as functions of time. The . 
growth curves raaJT^ estimated for several variables and for several 
groups of individuals simultaneously and various hypotheses may be 
tested such that (i).the growth curve has a specified degree, (ii) the 
growtrh curves are identical or parallel for several variables and/or 
groups. The estimation of growth curves when the response variables 
are auto-regressive is also considered. If th?- auto-regressive model 
holds, the growth curves can be estimated more effici^tly and the 
tests will be more powerful . ^ ^• 

Sections IV and V deal with models involving latent variables or 
hypothetical constructs and the related problem of measurement errors 
in the observed variables. The kernel in these models is a set of 
linear structural relationships among latent variables that are not 
directly observed but observed by means of two or more indicators, 
We consider models with or without background variables. Section IV 
deal's with two-wave models and section V with~multi-wave models. In . 
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subsections IV.E-F, we consider the conparison o£ change between groups 

f * ■ ■ . ■ 

under the assumption that certain characteristics o£ the response 

variables are invariant over groups" of people. 



For most of the models in,.sections IV and V we consider the 
identification problem. The estimation problem is considered in the 
sense that it is shown how to specify the jnodel for one of the 
three computer programs described in section II- For some of the taodels, 
the estimation and testing is illustrated by some data. 
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Book Prospectus? 
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Nesselroade/ J- R., 5 Baltes, P'. B, (Eds.). Longitudinal research in th^ 
behavioral sciences: Design and analysis. 



Objective 

This book will present a comprehensive overview 'Of. longitudinal 
research m^thodoXogy in the behavioral sciences (psychology, education, 
human developn nt) . Its special -features are that (a*) it-wil'l combine 
an easily comi)rehensible overview section' with .-Kiore technical '*forward- 
looking*' expositions, and (b) it will be co-authored by a multidisciplinary 
team of experts from psychology, . sociology, education, and statistics. 
The primary substantive emphasis, ' however, will be on the study of behavior 
by means' of longitudinal methodology. 



Background 

The volume is the product of a large-scale contract (1974-1976) 
which the National Institute of Education awarded.to the Pennsylvania.. 
State University and on uhich the editors were prSnclplil investigators. 
The chapters have been carefully prepared and co^srfdinated by the editors 
and will be (or are being) edited with a' primary view on quality an4 
substantive convergence. Expected manuscript length (typed) is 500 to 
600 pages. Expected completion date of manuscripts is May 50, 1977 . 



Audience ' ■ 

There is no ^comparable book available in the literature. It is 
expected that the volume will become widely used by graduate students 
and researchers interested in the study of behavioral development both 
in the behaviaral and social sciences. 



There is also a rather significant likelihood that neighboring 
disciplines (e.g., economics, anthropology, history) will use ^he volume 
as a source manual. In general, the editors e.xpect that the volume will 
enjoy a large and long-term market. 
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